12368 Big Data Jobs - Page 16

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

The ability to be a team player The ability and skill to train other people in procedural and technical topics Strong communication and collaboration skills Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Able to write complex SQL queries; Having experience in Azure Databricks Preferred technical and professional experience Excellent communication and stakeholder management skills

Your role and responsibilities As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include * Implementing and validating predictive models as well as creating and maintain statistical models with a...

Your role and responsibilities The ability to be a team player The ability and skill to train other people in procedural and technical topics Strong communication and collaboration skills Required education Bachelor's Degree Required technical and professional expertise Able to write complex SQL queries ; Having experience in Azure Databricks Preferred technical and professional experience Excellent communication and stakeholder management skills

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: * Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. * Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. * Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education ...

Senior Data Engineer Experience Range: 05 - 10 years Location: Bengaluru, India Responsibilities and Duties of the Role: Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needs Build next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability Contribute to the best engineering practices, including the use of design patterns, CI/CD, code review and automated test Chip in ground-breaking innovation and apply the state-of-the-art technologies As a key member of the team, contribute to all aspects of the ...

Demonstrated considerable experience (minimum 5-7 Years) implementing Data platform/Big data projects on Hyperscalars platform. (Primarily on AWS/Databricks & Google cloud) Extensive working experience on implementing data warehouse, data lake, data mart projects (5-8 years) Strong solution/architect skills in building Data engineering pipelines. (> 5 Years) Hands on experience working in AWS (glue, redshift, s3, athena)/Databricks/Spark (pyspark preferred) /Snowflake/Google cloud (GCS, Bigquery, dataproc, dataflow, composor) Experience working on Real team data engineering projects Having Data engineering Certifications will be added advantage Good to have Knowledge of AI/ML skills, ML Engi...

Overall experience between 10-15 years. Demonstrated considerable experience (minimum 5-7 Years) implementing Data platform/Big data projects on Hyperscalars platform. (Primarily on AWS/Databricks & Google cloud) Extensive working experience on implementing data warehouse, data lake, data mart projects (5-8 years) Strong solution/architect skills in building Data engineering pipelines. (> 5 Years) Hands on experience working in AWS (glue, redshift, s3, athena)/Databricks/Spark (pyspark preferred) /Snowflake/Google cloud (GCS, Big query, dataproc, dataflow, composor). Experience working on Real team data engineering projects Having Data engineering Certifications will be added advantage Good ...

we are looking for Data Engineer with ADF Required Skills: Azure Datafactory, ETL, SSIS, Big Data Expertise in Microsoft Azure Data Factory (ADF), Networking and SQL Server Integration Services (SSIS) preferred. Knowledge of Azure Purview is a plus. Knowledge of Big Data concepts such as structured data vs unstructured data vs semi structured data. Experience in Extract Transform Load (ETL) Extract Load Transform (ELT) pipelines.

we are looking for Data Engineer with ADF Required Skills: Azure Datafactory, ETL, SSIS, Big Data Expertise in Microsoft Azure Data Factory (ADF), Networking and SQL Server Integration Services (SSIS) preferred. Knowledge of Azure Purview is a plus. Knowledge of Big Data concepts such as structured data vs unstructured data vs semi structured data. Experience in Extract Transform Load (ETL) Extract Load Transform (ELT) pipelines.

we are looking for Data Engineer with ADF Required Skills: Azure Datafactory, ETL, SSIS, Big Data Expertise in Microsoft Azure Data Factory (ADF), Networking and SQL Server Integration Services (SSIS) preferred. Knowledge of Azure Purview is a plus. Knowledge of Big Data concepts such as structured data vs unstructured data vs semi structured data. Experience in Extract Transform Load (ETL) Extract Load Transform (ELT) pipelines.

we are looking for Data Engineer with ADF Required Skills: Azure Datafactory, ETL, SSIS, Big Data Expertise in Microsoft Azure Data Factory (ADF), Networking and SQL Server Integration Services (SSIS) preferred. Knowledge of Azure Purview is a plus. Knowledge of Big Data concepts such as structured data vs unstructured data vs semi structured data. Experience in Extract Transform Load (ETL) Extract Load Transform (ELT) pipelines.

we are looking for Data Engineer with ADF Required Skills: Azure Datafactory, ETL, SSIS, Big Data Expertise in Microsoft Azure Data Factory (ADF), Networking and SQL Server Integration Services (SSIS) preferred. Knowledge of Azure Purview is a plus. Knowledge of Big Data concepts such as structured data vs unstructured data vs semi structured data. Experience in Extract Transform Load (ETL) Extract Load Transform (ELT) pipelines.

we are looking for Data Engineer with ADF Required Skills: Azure Datafactory, ETL, SSIS, Big Data Expertise in Microsoft Azure Data Factory (ADF), Networking and SQL Server Integration Services (SSIS) preferred. Knowledge of Azure Purview is a plus. Knowledge of Big Data concepts such as structured data vs unstructured data vs semi structured data. Experience in Extract Transform Load (ETL) Extract Load Transform (ELT) pipelines.

we are looking for Data Engineer with ADF Required Skills: Azure Datafactory, ETL, SSIS, Big Data Expertise in Microsoft Azure Data Factory (ADF), Networking and SQL Server Integration Services (SSIS) preferred. Knowledge of Azure Purview is a plus. Knowledge of Big Data concepts such as structured data vs unstructured data vs semi structured data. Experience in Extract Transform Load (ETL) Extract Load Transform (ELT) pipelines.

About the Role We are seeking a highly skilled and proactive Lead QA Engineer with 47 years of strong hands-on experience in API testing, SQL, and Linux, along with exposure to or interest in Big Data testing. In this role, you will take ownership of quality across services, guide junior team members, and ensure robust end-to-end validation of complex data-driven applications. You will work closely with cross-functional teams to deliver high-quality, scalable, and reliable solutions. Key Responsibilities Design, develop, and execute comprehensive API test cases using tools like Postman, Rest Assured, etc. Perform backend data validations using advanced SQL queries (joins, aggregations, data ...

Employment Type: Full-time Must Have Skills: Any Cloud, OOP, ETL/ELT, Hive, Scala/Java/React, CI/CD, Kafka/Kinesis, Spark, Spark Streaming, SQL Good to have skills: GIT, Airflow or similar tools, Microservices Experience Level : 3-7 Years

Employment Type: Full-time Must Have Skills: Any Cloud, OOP, ETL/ELT, Hive, Scala/Java/React, CI/CD, Kafka/Kinesis, Spark, Spark Streaming, SQL Good to have skills: GIT, Airflow or similar tools, Microservices Experience Level : 3-7 Years

Employment Type: Full-time Must Have Skills: Any Cloud, OOP, ETL/ELT, Hive, Scala/Java/React, CI/CD, Kafka/Kinesis, Spark, Spark Streaming, SQL Good to have skills: GIT, Airflow or similar tools, Microservices Experience Level : 3-7 Years

Employment Type: Full-time Must Have Skills: Any Cloud, OOP, ETL/ELT, Hive, Scala/Java/React, CI/CD, Kafka/Kinesis, Spark, Spark Streaming, SQL Good to have skills: GIT, Airflow or similar tools, Microservices Experience Level : 3-7 Years

Employment Type: Full-time Must Have Skills: Any Cloud, OOP, ETL/ELT, Hive, Scala/Java/React, CI/CD, Kafka/Kinesis, Spark, Spark Streaming, SQL Good to have skills: GIT, Airflow or similar tools, Microservices Experience Level : 3-7 Years

Employment Type: Full-time Must Have Skills: Any Cloud, OOP, ETL/ELT, Hive, Scala/Java/React, CI/CD, Kafka/Kinesis, Spark, Spark Streaming, SQL Good to have skills: GIT, Airflow or similar tools, Microservices Experience Level : 3-7 Years

Employment Type: Full-time Must Have Skills: Any Cloud, OOP, ETL/ELT, Hive, Scala/Java/React, CI/CD, Kafka/Kinesis, Spark, Spark Streaming, SQL Good to have skills: GIT, Airflow or similar tools, Microservices Experience Level : 3-7 Years

Big Data Engineer 3+Yrs Immediate Joinees Remote Must Have Skills: Any Cloud, OOP, ETL/ELT, Hive, Scala/Java/React, CI/CD, Kafka/Kinesis, Spark, Spark Streaming, SQL

Big Data Engineer 3+Yrs Immediate Joinees Remote Must Have Skills: Any Cloud, OOP, ETL/ELT, Hive, Scala/Java/React, CI/CD, Kafka/Kinesis, Spark, Spark Streaming, SQL