988 Glue Jobs - Page 6

• Proficiency in Python, PySpark and SQL for data processing and manipulation. • Min 5 years of experience in data engineering, specifically working with Apache Airflow and AWS technologies. • Understanding of Snowflake Data Lake is preferred.

As a Data Engineer on Contract with 4-8 years of experience, you will play a crucial role in building and maintaining data systems on AWS. Your responsibilities will include designing and constructing efficient data pipelines using Spark, PySpark, or Scala, managing complex data processes with Airflow, and cleaning, transforming, and preparing data for analysis. You will utilize Python for data tasks, automation, and tool development, while collaborating with the Analytics team to understand their data requirements and provide appropriate solutions. In this role, you will work with various AWS services such as S3, Redshift, EMR, Glue, and Athena to manage the data infrastructure effectively....

As a Data Engineer, you will be responsible for designing and implementing next-generation data pipelines, analytics, and Business Intelligence solutions. You will manage various AWS resources such as RDS, EMR, MWAA, and Lambda. Your primary focus will be on developing high-quality data architecture and pipelines to support business analysts and data scientists. Collaborating with other technology teams, you will extract, transform, and load data from diverse sources. Additionally, you will work towards enhancing reporting and analysis processes by automating self-service support for customers. You should have a solid background with 7-10 years of data engineering experience, including exper...

Position : Senior Quantitative Engineer - Systematic Strategies Location: Navi Mumbai or Delhi Shift: UK The Role: As a Senior Quantitative Engineer, you will design, implement, and maintain the data and systems architecture that powers Morningstar’s Systematic Strategies portfolios.For this you are expected to work closely with portfolio managers, researchers, and developers to help build, scale, and optimize the infrastructure that powers quantitative research and investment management. You should understand the nuances of the data and prepare it for ingestion, and your daily work with researchers and portfolio managers will facilitate the research, design, and deployment of quantitative s...

Role & responsibilities Skill - Data engineer python AWS Exp - 10+ Location - Gurugram NP - only immediate joiners needed Preferred candidate profile We are seeking an experienced Lead Data Engineer with strong expertise in Python, AWS cloud services, ETL pipelines, and system integrations. The ideal candidate will lead the design, development, and optimization of scalable data solutions and ensure seamless API and data integrations across systems. You will collaborate with cross-functional teams to implement robust DataOps and CI/CD pipelines. Key Responsibilities: Responsible for implementation of scalable, secure, and high-performance data pipelines. Design and develop ETL processes using...

About The Role What we offer Our mission is simple Building trust. Our customer's trust in us is not merely about the safety of their assets but also about how dependable our digital offerings are. That"™s why, we at Kotak Group are dedicated to transforming banking by imbibing a technology-first approach in everything we do, with an aim to enhance customer experience by providing superior banking services. We welcome and invite the best technological minds in the country to come join us in our mission to make banking seamless and swift. Here, we promise you meaningful work that positively impacts the lives of many. About our team DEX is a central data org for Kotak Bank which manages entire...

About The Role Data Engineering Manager 5-9 years Software Development Manager 9+ Years Kotak Mahindra BankBengaluru, Karnataka, India (On-site) What we offer Our mission is simple Building trust. Our customer's trust in us is not merely about the safety of their assets but also about how dependable our digital offerings are. That"™s why, we at Kotak Group are dedicated to transforming banking by imbibing a technology-first approach in everything we do, with an aim to enhance customer experience by providing superior banking services. We welcome and invite the best technological minds in the country to come join us in our mission to make banking seamless and swift. Here, we promise you meani...

About The Role Data Engineer -2 (Experience 2-5 years) What we offer Our mission is simple Building trust. Our customer's trust in us is not merely about the safety of their assets but also about how dependable our digital offerings are. That"™s why, we at Kotak Group are dedicated to transforming banking by imbibing a technology-first approach in everything we do, with an aim to enhance customer experience by providing superior banking services. We welcome and invite the best technological minds in the country to come join us in our mission to make banking seamless and swift. Here, we promise you meaningful work that positively impacts the lives of many. About our team DEX is a central data...

Eli Lilly Services India Pvt Ltd Business Insights & Analytics Team: Data Engineer The purpose of the LCCI Business Insights & Analytics team is to partner with US Business Insights & Analytics in providing high quality analytical support to Brand, Market Research and other internal partners through right data, smart analytics and actionable insights. Our team will be responsible for setting up the data warehouses necessary to handle large volumes of data, create meaningful analyses, and deliver recommendations to leadership. As part of the LCCI team, we are excited to offer the role of Data Engineer who will be an integral part of the Business Insights and Analytics team. Core Responsibilit...

About KPMG in India KPMG entities in India are professional services firm(s) affiliated with KPMG International Limited, established in India in August 1993. Our professionals leverage the global network of firms and possess in-depth knowledge of local laws, regulations, markets, and competition. With offices spread across India in cities like Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Jaipur, Hyderabad, Kochi, Kolkata, Mumbai, Noida, Pune, Vadodara, and Vijayawada, KPMG entities in India offer services to national and international clients across various sectors. We aim to provide rapid, performance-based, industry-focused, and technology-enabled services that demonstrate our unde...

Key Responsibilities: Design, develop, and optimize scalable and reliable ETL pipelines using Python and PySpark . Extract data from diverse data sources and transform it to meet analytical and business needs. Implement robust data validation, error handling, and quality checks within ETL pipelines. Work with large-scale datasets and ensure efficient performance and scalability. Collaborate with data engineers, analysts, and stakeholders to gather requirements and deliver end-to-end data solutions. Deploy and monitor ETL processes on AWS cloud services such as S3, Glue, Lambda, EMR, Redshift, Step Functions , etc. Ensure compliance with data governance and security standards. Troubleshoot an...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

At Tredence AWS Data Engineer designs, builds, and maintains scalable data pipelines and infrastructure using AWS services like Glue, S3, and Redshift, focusing on data ingestion, transformation (ETL), modeling, and quality. They write SQL and Python code, orchestrate workflows with tools like Airflow, and collaborate with data scientists and analysts, aiming to ensure data is accurate, accessible, and optimized for analysis and business decision-making. Role - AWS Data Engineer Years of Experience: 2~5 years Roles and responsibilities The day-to-day work of a junior-to-mid AWS data engineer involves a mix of development, monitoring, and collaboration. Pipeline development: Designing, buildi...

We are conducting a Walk-In Interview in Hyderabad for the position of Data Engineering on 5th/6th/7th September 2025. Note: Candidates who attended interview with us last 6 months are not eligible. Position: Data Engineering Job description: Expert knowledge in AWS Data Lake implementation and support (S3, Glue,DMS Athena, Lambda, API Gateway, Redshift) Handling of data related activities such as data parsing, cleansing quality definition data pipelines, storage and ETL scripts Experiences in programming language Python/Pyspark/SQL Experience with data migration with hands-on experience Experiences in consuming rest API using various authentication options with in AWS Lambda architecture or...

Genpact is a global professional services and solutions firm with a workforce of over 125,000 employees in more than 30 countries. Our team is characterized by curiosity, agility, and a commitment to delivering lasting value to clients. Driven by our purpose of creating a world that works better for people, we cater to leading enterprises, including Fortune Global 500 companies, by leveraging our deep industry knowledge, digital operations services, and expertise in data, technology, and AI. We are currently seeking applications for the position of Lead Consultant COE Data Engineer. In this role, you will collaborate with clients" Data Science and Data Engineering teams to ensure the deliver...

As a senior software engineer at our company, you will have the opportunity to work with cutting-edge technologies to design and build high-performance and scalable products in the AWS Cloud environment. Your responsibilities will include developing solutions and components using JavaScript frameworks, Python, and various AWS technologies such as Redshift, Aurora, and Glue for enterprise-scale multi-user applications. To qualify for this role, you should have a Bachelor's degree in Math, EE, CS, or Software Engineering, with a Master's degree being preferred. You should also have at least 5 years of hands-on experience in developing commercial-grade software products and a minimum of 3 years...

As a Data Engineer, you will be responsible for designing and implementing data pipelines using various AWS services including S3, Glue, PySpark, and EMR. Your role will involve optimizing data storage and retrieval through AWS database services such as RDS, Redshift, and DynamoDB. Building different data warehousing layers to cater to specific use cases will be a key aspect of your responsibilities. Your expertise in SQL and strong understanding of ETL processes and data modeling will be essential in ensuring the accuracy and availability of data to customers. You will also need to comprehend how technical decisions can impact business analytics and reporting for our clients. Experience wit...

We are seeking an experienced Scala and Databricks Developer with a strong background in constructing data solutions on AWS. As the ideal candidate, you will possess hands-on expertise in crafting data pipelines, enhancing big data solutions, and enforcing best practices utilizing Scala, Databricks, and various AWS services. Your pivotal role will involve designing and delivering scalable, dependable, and high-performance data solutions to meet our business objectives effectively. Your responsibilities will encompass collaborating with data architects and analysts to devise and implement data models and processing frameworks. You will be tasked with optimizing the performance of data workflo...

Location: Remote. Role & responsibilities We are seeking a highly skilled and experienced Data Engineer for AWS to join our team and play a crucial role in designing and implementing data analytics solutions on the Amazon Web Services (AWS) platform. The ideal candidate will have a deep understanding of data analytics technologies, AWS services, and a track record of architecting scalable and efficient data solutions to address complex business challenges. Responsibilities: • Design, build, and maintain scalable data pipelines on AWS using services such as Amazon S3, Glue, and EMR. • Develop and optimize ETL processes to ingest data from various sources into our data lake and data warehouse....

Role & Responsibilities: Design and implement test strategies for ETL processes and data pipelines. Perform data validation, transformation, and reconciliation testing. Develop and maintain automated test scripts using Python or PySpark. Conduct API testing and validate data exchange between systems. Collaborate with developers, data engineers, and business analysts to ensure data quality. Manage test data and environments for various testing phases. Utilize orchestration tools like Airflow, Jenkins, or Control-M for job scheduling and monitoring. Perform EDI file testing and validation. Work with cloud services (preferably AWS) for data storage, processing, and testing. Use tools like ICEDQ...

Roles & Responsibilities : • We are looking for a strong Senior Data Engineering who will be majorly responsible for designing, building and maintaining ETL/ ELT pipelines . • Integration of data from multiple sources or vendors to provide the holistic insights from data. • You are expected to build and manage Data Lake and Data warehouse solutions, design data models, create ETL processes, implementing data quality mechanisms etc. • Perform EDA (exploratory data analysis) required to troubleshoot data related issues and assist in the resolution of data issues. • Should have experience in client interaction oral and written. • Experience in mentoring juniors and providing required guidance t...

Experienced in cloud operations in AWS services like Lambda Glue S3 Redshift, SNS and SQS. Skilled in planning, designing, and developing cloud applications. Collaborates with engineering teams to design and deploy scalable enterprise-wide solutions.

Experienced in cloud operations in AWS services like Lambda Glue S3 Redshift, SNS and SQS. Skilled in planning, designing, and developing cloud applications. Collaborates with engineering teams to design and deploy scalable enterprise-wide solutions.

Experienced in cloud operations in AWS services like Lambda Glue S3 Redshift, SNS and SQS. Skilled in planning, designing, and developing cloud applications. Collaborates with engineering teams to design and deploy scalable enterprise-wide solutions.

Experienced in cloud operations in AWS services like Lambda Glue S3 Redshift, SNS and SQS. Skilled in planning, designing, and developing cloud applications. Collaborates with engineering teams to design and deploy scalable enterprise-wide solutions.