354 Aws Emr Jobs - Page 5

Role Overview: You are a highly skilled and experienced Senior ETL & Data Streaming Engineer with over 10 years of experience. Your main responsibility will be to design, develop, and maintain robust data pipelines. Your expertise in both batch ETL processes and real-time data streaming technologies, along with hands-on experience with AWS data services, will be crucial. Your track record in working with Data Lake architectures and traditional Data Warehousing environments will be essential for this role. Key Responsibilities: - Design, develop, and implement highly scalable, fault-tolerant, and performant ETL processes using industry-leading ETL tools to extract, transform, and load data fr...

Role & responsibilities Role : Pyspark Developer Location: Bangalore, Chennai, Pune, Hyderabad, Gurugram Date of Interview: 30th Oct, 2025 Time of Interview: 10:00 AM to 4:00 PM Job Description: Overall 5+ years of experience in Pyspark, Big Data experience, AWS EMR, S3, IAM, Lambda, SNS, SQS Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good Spark, Pyspark, Big Data experience Spark UI/Optimization/debugging techniques Good python scripting skills Intermediate SQL exposure Subquery, Joins, CTEs Database technologies AWS EMR, S3, IAM, Lambda, SNS, SQS

Job description Hiring for AWS Developer Mandatory Skills: AWS cloud , AWS Lambda/Glue Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed fun...

Overview We are seeking a Data Engineer to join our data engineering team, focusing on data processing and analytics solutions using big modern data technologies. Responsibilities Develop and maintain data processing pipelines using Python, Spark, and Hadoop ecosystems. Build ETL workflows on AWS EMR clusters for processing large datasets. Assist in optimizing Spark applications for performance and reliability. Support data visualization and exploration using Hue and other analytics platforms. Work with data scientists and analysts on machine learning pipeline implementation. Monitor distributed computing environments and assist with troubleshooting. Qualifications 3+ years of software devel...

Role & responsibilities Proficient in Python for data processing and automation. Strong experience with Apache Spark for large-scale data processing. Familiarity with AWS S3 for data storage and management. Experience with Kafka for real-time data streaming. Knowledge of Redshift for data warehousing solutions. Proficient in Oracle databases for data management. Experience with AWS Glue for ETL processes. Familiarity with Apache Airflow for workflow orchestration. Experience with EMR for big data processing. Mandatory: Strong AWS data engineering skills. Apply link : https://careers.ey.com/job-invite/1625618/

Role & responsibilities Experience building on AWS using S3, EC2, Redshift, Glue, EMR, DynamoDB, Lambda, Quick Sight, etc. Experience in Pyspark/Spark / Scala Experience using software version control tools (Git, Jenkins, Apache Subversion) AWS certifications or other related professional technical certifications Experience with cloud or on-premises middleware and other enterprise integration technologies. Experience in writing MapReduce and/or Spark jobs. Demonstrated strength in architecting data warehouse solutions and integrating technical components. Good analytical skills with excellent knowledge of SQL. 3+ years of work experience with very large data warehousing environment 3+ years ...

Project Duration 3 months and can get extended. Data Engineer (Databricks experience is mandatory) Exp: 3-8 Years Qualification: B. Tech/B.Sc. (IT) Expertise in Python, PySpark , and Apache Spark for data engineering Strong experience in building and optimizing ETL/data transformation pipelines Proficient in Databricks and Delta Lake storage format (Databricks experience is mandatory) Cloud platforms like AWS (Glue, EMR), Snowflake, Dataiku, Alteryx Skilled in managing large-scale, multi-dimensional datasets and designing scalable data architectures Solid understanding of data modeling and data warehouse concepts (On-Prem & Cloud) Familiar with modern data tools and continually updated on em...

Role Overview: You will be responsible for designing, developing, and maintaining data pipelines and solutions using Databricks, Apache Spark, and other related tools to process large datasets and extract actionable business insights. Your role will involve building metrics deck and dashboards for KPIs, including the underlying data models. Additionally, you will be required to design, implement, and maintain a platform providing secured access to large datasets. Key Responsibilities: - Hold a Bachelor's degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline - Possess 5+ years of relevant experience in data engineering roles...

Data Engineer Immediate joiner only Bangalore /Chennai (Local candidates) Job Duties: Develop and support data solutions in support of Geo and Marketplace reporting and analytics requirements Engage with product owner, technology lead, report developers, product analysts, and business partners to understand capability requirements and develop data solutions based on product backlog priorities Skills / Qualifications: 5+ years of experience with data engineering with emphasis on data analytics and reporting Expert level experience with Python which demonstrate: Proficiency authoring distributable packages Proficiency authoring and automating unit tests using tools such as tox and pytest , pre...

As a Pyspark Developer at our company, you will be responsible for optimizing Pyspark applications to improve performance and resource utilization, ensuring efficient data processing and analysis. Your key responsibilities will include: - Developing and maintaining scalable solutions using AWS EC2 and AWS EMR to support business needs and data-driven decision-making. - Implementing PySpark frameworks to process large datasets, enhancing data accessibility and insights for stakeholders. - Collaborating with cross-functional teams to design and deploy robust data pipelines, ensuring seamless integration with existing systems. - Utilizing Python programming to automate tasks and streamline work...

Role Overview: As an IT professional at Capgemini Invent, you will be responsible for creating data warehouses, data lakes, ETL/ELT, and data pipelines on cloud platforms. Your focus will be on delivering cutting-edge solutions tailored to the challenges faced by clients in the Life Sciences Domain. You will leverage your expertise in cloud storage, cloud database, and data warehousing solutions such as Snowflake, BigQuery, AWS Redshift, ADLS, and S3. Additionally, you will use cloud data integration services like Azure Databricks, Azure Data Factory, Azure Synapse Analytics, AWS Glue, AWS EMR, Dataflow, and Dataproc for handling structured, semi-structured, and unstructured data. Your role ...

Design and develop integration of Snowflake with a cloud platform and platform enhancements, integrations, and performance optimisation. Work on data ingestion using Python, cataloguing, and lineage tracking, Develop and architect ETL workflows. Required Candidate profile 5 years in developing and scaling data platforms centered around Snowflake, with Azure. Hands on Python Understanding of modern data architectures such as Data Mesh, Lakehouse, and ELT.

As an Applied AI ML Lead within the Digital Intelligence team at JPMorgan, you will collaborate with all lines of business and functions to deliver software solutions. You will experiment, develop, and productionize high-quality machine learning models, services, and platforms to make a significant impact on technology and business. You will design and implement highly scalable and reliable data processing pipelines. Additionally, you will perform analysis and insights to promote and optimize business results. You will contribute to a transformative journey and make a substantial impact on a wide range of customer products. - Research, develop, and implement machine learning algorithms to so...

AWS Data Engineer Experience :- 5+ years Location : Remote Job Description Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code Integration of data storage solutions in spark especially with AWS S3 object storage. Performance tuning of pySpark scripts. Need to ensure overall build delivery quality is good and on-time delivery is done at all times. Should be able to handle meetings with customers with ease. Need to have excellent communication skills to interact with the customer. Be a team player and willing to work in an onsite-offshore model, mentor other folks in the team (...

Urgent Hiring: AWS Data Engineer, Senior Data Engineers & Lead Data Engineers Apply Now: Send your resume to heena.ruchwani@gspann.com Location: Bangalore (6+ Years Experience) Company: GSPANN Technologies, Inc. GSPANN Technologies is seeking talented professionals with 4+ years of experience to join our team in Bangalore. We are looking for immediate joiners who are passionate about data engineering and eager to take on exciting challenges. Key Skills & Experience: 6+ years of hands-on experience with AWS Data Services (Glue, Redshift, S3, Lambda, EMR, Athena, etc.) Strong expertise in Big Data Technologies (Spark, Hadoop, Kafka) Proficiency in SQL, Python, and Scala Hands-on experience wit...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Requirements for the candidate: Data Engineer with a minimum of 7+ years of experience of data engineering experience. The role will require deep knowledge of data engineering techniques to create data pipelines and build data assets. At least 4+ years of Strong hands on programming experience with Pyspark / Python / Boto3 including Python Frameworks, libraries according to python best practices. Strong experience in code optimization using spark SQL and pyspark. Understanding of Code versioning, Git repository, JFrog Artifactory. AWS Architecture knowledge specially on S3, EC2, Lambda, Redshift, CloudFormation etc and able to explain benefits of each Code Refactorization of Legacy Codebase:...

As the Data Platform Engineering Lead at JPMorgan Chase within Asset and Wealth Management, you play a crucial role as part of an agile team dedicated to enhancing, building, and delivering cutting-edge technology products securely and at scale. Your responsibilities involve leading the design, development, and implementation of scalable data pipelines, mentoring a team of data engineers, collaborating with stakeholders, and ensuring optimal data infrastructure on cloud platforms. - Lead the design, development, and implementation of scalable data pipelines and ETL batches using Python/PySpark on AWS. - Execute standard software solutions, design, development, and technical troubleshooting. ...

Lead Data Engineer Skills Mandatory- S3, Glue, Lambda, Step Function, Snowflake . Skills - Primary - PySpark, Snowflake. Skills - Good to have - Cassandra Total Experience - 7+ years ; Relevant Experience - 5+ years Work Location : Cochin/TVM Job Purpose Responsible for consulting for the client to understand their data needs and delivering data solution to the client. Job Description / Duties & Responsibilities Data Ingestion Framework: oDesign & Development: Design, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data from diverse sources. oFramework Optimization: Use AWS services such as AWS Glue, Lambda, EC2 and Step Functions...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

We are seeking a talented and motivated Data Engineer to join our founding team in India. This role is critical in shaping the data foundation of the Axyo AI platform and our enterprise applications. As an early member of our India team, you will work closely with the VP of Data Science, ML Engineers, and DevOps Engineers to design and implement robust data pipelines, scalable infrastructure, and high-quality data systems that power our AI products. Responsibilities Data Infrastructure & Pipelines Design, develop, and maintain scalable, eff icient, and reliable automated ETL pipelines. Integrate diverse structured and unstructured data sources into unifi ed data models. Implement data qualit...

Job Description We are seeking a talented and motivated ML Engineer to join our founding team in India. This role is central to building AI solutions on the Axyo platform that solve high-value problems for enterprise clients. As an early member of our India team, you will work closely with the VP of Data Science, Data Engineers, and Product Managers to design, train, and deploy machine learning models that power Axyo AI Apps. Responsibilities Applied Machine Learning & Modeling Design, train, and evaluate predictive, classifi cation, forecasting, and optimization models. Build and experiment with ML pipelines across traditional statistical methods and modern ML/deep learning approaches. Appl...

Job Description We are seeking a talented and motivated ML Engineer to join our founding team in India. This role is central to building AI solutions on the Axyo platform that solve high-value problems for enterprise clients. As an early member of our India team, you will work closely with the VP of Data Science, Data Engineers, and Product Managers to design, train, and deploy machine learning models that power Axyo AI Apps. Responsibilities Applied Machine Learning & Modeling Design, train, and evaluate predictive, classifi cation, forecasting, and optimization models. Build and experiment with ML pipelines across traditional statistical methods and modern ML/deep learning approaches. Appl...

Kick-start your software engineering career as an entry-level Software Engineer I. Be part of a team that is pushing the boundaries of what's possible. As a Software Engineer I at JPMorgan Chase within the Commercial and Investment Bank's Global Banking Team, you are part of an agile team that works to enhance, design, and deliver the software components to the firm's state-of-the-art technology products in a secure, stable, and scalable way. As an entry-level member of a software engineering team, you execute basic software solutions through the design, development, and troubleshooting of a single technical area within a business function, while gaining skills and experience to grow within ...

We are looking for a Manager Software Engineering to join our IMS Team in Bangalore . This is an amazing opportunity to work on Big Data technologies involved in content ingestion. The team consists of 10-12 engineers and is reporting to the Sr Manager. We have a great skill set in Spark, Java, Scala, Hive, Sql, XSLT, AWS EMR, S3, etc and we would love to speak with you if you have skills in the same. About You experience, education, skills, and accomplishments: Work Experience: Minimum 7 years experience in Big Data projects involved in content ingestion, curation, transformation Technical Skill: Databricks, Spark, Python/Java , Scala, AWS EMR, S3, SQS, Hive, XSLT, Education (bachelors degr...