103 Spark Programming Jobs

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing...

Infosys Hirings for PYSPARK DEVELOPER EXPERIENCE: 5-10 YEARS LOCATION: PAN INDIA SKILLS REQUIRED: PYSPARK, PYTHON, SPARK EDUCATION : BTECH/BE/MTECH/ME/BSC/MSC/BCA/MCA

As an Applications Development Senior Programmer Analyst, you will play a crucial role in establishing and implementing new or revised application systems and programs in coordination with the Technology team. Your contributions will be vital in applications systems analysis and programming activities. Responsibilities: - Conduct feasibility studies, time and cost estimates, IT planning, risk technology, applications development, and establish new or revised applications systems and programs to meet specific business needs - Monitor and control all phases of the development process including analysis, design, construction, testing, and implementation, providing user and operational support t...

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

The Data Engineering team is responsible for building and maintaining the data applications and platform that enables the ISS business to operate. This role is appropriate for a senior data engineer capable of taking ownership and a delivering a subsection of the wider data platform or data applications. As a Senior Data Engineer, you will directly contribute to our key organizational objectives of Accelerated Innovation, Cost Optimization, Risk Mitigation, and Business Enablement Key Responsibilities • Implement and maintain data pipelines for ingestion, transformation, and delivery • Ensure data quality through validation and monitoring processes • Collaborate with senior engineers to desi...

Role Overview: You will be an Applications Development Senior Programmer Analyst, responsible for participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your main objective will be to contribute to applications systems analysis and programming activities. Key Responsibilities: - Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas - Monitor and control all phases of the development process...

We are seeking an experienced Apache Spark Developer to design, develop, and optimize big data processing pipelines using Spark . The ideal candidate will have strong expertise in distributed computing , data engineering , and performance tuning , with experience in building scalable data solutions on cloud or on-prem platforms. Key Responsibilities: Design and implement data processing pipelines using Apache Spark (Core, SQL, Streaming). Develop and optimize ETL workflows for large-scale data ingestion and transformation. Work with Spark on Hadoop , Databricks , or cloud-based Spark environments . Collaborate with data engineers , data scientists , and business teams to deliver analytics so...

We are seeking a highly skilled and experienced Senior Data Engineer (Azure+DBT) with strong expertise in Streaming Data and Big Data Technologies . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Strong expertise in: Azure Cloud Services o Databricks (including workflows and notebooks) PySpark and Python o SQL (complex queries, performance tuning) Azure Data Factory (ADF) DBT (Data Build Tool) o ServiceNow (incident and change management) Experience in reverse engineering and legacy system modernization is a plus. Excellent problem-solving and communication skills.

HIRINGS FOR SPARK-SCALA-PYTHON DEVELOPER Responsibilities : As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews. You will lead and guide your teams towards developing optimized high quality code deliverables, continual knowledge management and ad...

Skills Required Commercial experience of core Java programming with strong proficiency Experience of working with a functional programming language Experience with Scala programming (or willingness on becoming an expert on it) Fundamental knowledge of Microservices Strong experience with distributed caching and relational databases, preferably with Sybase, Oracle, MSSQL Good Exposure to middleware- MQ, Kafka Experience of working in a Linux environment Strong analytical and problem-solving skills Strong oral and written communication skills Excellent interpersonal skills and professional approach Ability to work effectively in a global and dynamic team Understanding of distributed system des...

We are seeking a highly skilled and experienced Senior Data Engineer (Azure+DBT) with strong expertise in Streaming Data and Big Data Technologies . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Strong expertise in: Azure Cloud Services o Databricks (including workflows and notebooks) PySpark and Python o SQL (complex queries, performance tuning) Azure Data Factory (ADF) DBT (Data Build Tool) o ServiceNow (incident and change management) Experience in reverse engineering and legacy system modernization is a plus. Excellent problem-solving and communication skills.

HIRINGS FOR SPARK DEVELOPER Responsibilities : As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews. You will lead and guide your teams towards developing optimized high quality code deliverables, continual knowledge management and adherence to th...

We are seeking a highly skilled and experienced Senior Data Engineer (Azure+DBT) with strong expertise in Streaming Data and Big Data Technologies . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Strong expertise in: Azure Cloud Services o Databricks (including workflows and notebooks) PySpark and Python o SQL (complex queries, performance tuning) Azure Data Factory (ADF) DBT (Data Build Tool) o ServiceNow (incident and change management) Experience in reverse engineering and legacy system modernization is a plus. Excellent problem-solving and communication skills.

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

We are seeking a highly skilled and experienced Senior Data Engineer (Azure+DBT) with strong expertise in Streaming Data and Big Data Technologies . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Strong expertise in: Azure Cloud Services o Databricks (including workflows and notebooks) PySpark and Python o SQL (complex queries, performance tuning) Azure Data Factory (ADF) DBT (Data Build Tool) o ServiceNow (incident and change management) Experience in reverse engineering and legacy system modernization is a plus. Excellent problem-solving and communication skills.

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

We are seeking an experienced Apache Spark Developer to design, develop, and optimize big data processing pipelines using Spark . The ideal candidate will have strong expertise in distributed computing , data engineering , and performance tuning , with experience in building scalable data solutions on cloud or on-prem platforms. Key Responsibilities: Design and implement data processing pipelines using Apache Spark (Core, SQL, Streaming). Develop and optimize ETL workflows for large-scale data ingestion and transformation. Work with Spark on Hadoop , Databricks , or cloud-based Spark environments . Collaborate with data engineers , data scientists , and business teams to deliver analytics so...

We are seeking a highly skilled and experienced Senior Data Engineer (Azure+DBT) with strong expertise in Streaming Data and Big Data Technologies . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Strong expertise in: Azure Cloud Services o Databricks (including workflows and notebooks) PySpark and Python o SQL (complex queries, performance tuning) Azure Data Factory (ADF) DBT (Data Build Tool) o ServiceNow (incident and change management) Experience in reverse engineering and legacy system modernization is a plus. Excellent problem-solving and communication skills.

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

We are seeking a highly skilled and experienced Senior Data Engineer (Azure+DBT) with strong expertise in Streaming Data and Big Data Technologies . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Strong expertise in: Azure Cloud Services o Databricks (including workflows and notebooks) PySpark and Python o SQL (complex queries, performance tuning) Azure Data Factory (ADF) DBT (Data Build Tool) o ServiceNow (incident and change management) Experience in reverse engineering and legacy system modernization is a plus. Excellent problem-solving and communication skills.

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...