1333 Aws Glue Jobs - Page 21

Your Role IT experience with a minimum of 5+ years of experience in creating data warehouses, data lakes, ETL/ELT, data pipelines on cloud. Has data pipeline implementation experience with any of these cloud providers - AWS, Azure, GCP. preferably - Life Sciences Domain Experience with cloud storage, cloud database, cloud Data ware housing and Data Lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Experience with cloud storage, cloud database, cloud Data ware housing and Data Lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Experience in using cloud data integration services for structured, semi structured and unstructured data such as Azure Databricks, Azure...

This is 100% WFO opportunity at our Whitefield, Bengaluru office. Please don't apply if you can't comply. Position Overview: We seek a highly skilled and experienced Data Engineering Lead to join our team. This role demands deep technical expertise in Apache Spark, Hive, Trino (formerly Presto), Python, AWS Glue, and the broader AWS ecosystem. The ideal candidate will possess strong hands-on skills and the ability to design and implement scalable data solutions, optimise performance, and lead a high-performing team to deliver data-driven insights. Key Responsibilities: Technical Leadership Lead and mentor a team of data engineers, fostering best practices in coding, design, and delivery. Dri...

As a Senior Developer in AWS Data Engineering, you will have the opportunity to design, build, and optimize large-scale data pipelines on AWS, enabling high-performance analytics and AI-ready data platforms. **Key Responsibilities:** - Build & manage data pipelines using Glue, Spark & S3 - Optimize Redshift queries, schema & performance - Support large-scale data ingestion & transformation - Integrate with upstream APIs & external platforms - Ensure data reliability, observability & monitoring **Qualifications Required:** - Strong expertise in AWS Glue, S3 & Redshift - Proficiency in Python, SQL & Spark - Solid understanding of data warehouse & lake concepts - Experience with incremental pip...

As a Senior Data Engineer at our company, you will play a crucial role in leading the design, development, and optimization of scalable, secure, and high-performance data solutions in Databricks. Your responsibilities will include: - Leading Data Architecture & Development by designing and optimizing data solutions in Databricks - Building and maintaining ETL/ELT pipelines, integrating Databricks with Azure Data Factory or AWS Glue - Implementing machine learning models and AI-powered solutions for business innovation - Collaborating with data scientists, analysts, and business teams to translate requirements into technical designs - Enforcing data validation, governance, and security best p...

Job Duties: Wyndham Group of Hotels is advancing its modern data platform on Databricks (AWS) and is seeking a senior offshore data engineering lead to build high-performance, production-grade data pipelines. This role is not migration-focused initially but will evolve into one. The current mandate is to ingest semi-structured JSON data dropped via SFTP to S3, transform and validate it using Databricks, and deliver curated datasets into Amazon Redshift. This is a player-coach role, ideal for a technically hands-on leader capable of delivering pipelines while mentoring junior engineers and ensuring best practices across the offshore team. Initial Scope and Responsibilities:Develop high-perfor...

Job Duties: Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems. Document ETL processes and migration steps. Minimum Skills Required: Strong hands-on experience with SAP BODS. Proficiency in PySpark and Python scripting. Experience with AWS PostgreSQL (schema design, performance tuning, migration). Strong SQL and data modelling skills. Experience with Unix/Linux and shell scripting. Knowledg...

We are looking for an experienced Data Engineer to join our team and support the Data Analytics Platform. This role focuses on building and maintaining scalable, secure, and high-performance data infrastructure using AWS services.

Expertise in Tableau Experience integrating with Redshift or other DWH Platforms and understanding DWH concepts. Python or similar scripting languages Experience with AWS Glue, Athena, or other AWS data services.Strong SQL skills, AWS QuickSight

Senior Data Engineer - Cloud Data Platform Position Overview We are seeking a highly skilled Senior Data Engineer to join our data platform team, responsible for designing and implementing scalable, cloud-native data solutions. This role focuses on building modern data infrastructure using AWS and Azure services to support our growing analytics and machine learning initiatives. Key Responsibilities Business Translation : Collaborate with business stakeholders to understand requirements and translate them into scalable data models, architectures, and robust end-to-end data pipelines ETL/ELT Implementation : Design, develop, and maintain high-performance batch and real-time data pipelines usin...

Position Overview: We seek a highly skilled and experienced Data Engineering Lead to join our team. This role demands deep technical expertise in Apache Spark, Hive, Trino (formerly Presto), Python, AWS Glue, and the broader AWS ecosystem. The ideal candidate will possess strong hands-on skills and the ability to design and implement scalable data solutions, optimise performance, and lead a high-performing team to deliver data-driven insights. Key Responsibilities: Technical Leadership Lead and mentor a team of data engineers, fostering best practices in coding, design, and delivery. Drive the adoption of modern data engineering frameworks, tools, and methodologies to ensure high-quality and...

Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold data lakehouse model, and ensuring scalable and reliable data solutions. Required Skills and Experience: 6+ years of hands-on data engineering experience, with 2+ years specifically working on Databricks in Azure or AWS. Proficiency in building and optimizing Spark pipelines (batch and streaming). Strong experience implementing bronze/silver/gold data models. Working knowledge of cloud storage systems (ADLS, S3) and comput...

Role Overview: We are seeking an experienced Data Architect specializing in Databricks to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to Databricks on Azure or AWS . The role involves designing scalable, secure, and high-performing data platforms based on the medallion architecture (bronze, silver, gold layers), supporting large-scale ingestion, transformation, and publishing of data. Required Skills and Experience: 8+ years of experience in data architecture or engineering roles, with at least 3+ years specializing in cloud-based big data solutions. Hands-on expertise with Databricks on Azure or AWS . Dee...

Design and implement scalable data processing solutions usingApache SparkandJava. Develop and maintain high-performance backend services and APIs. Collaborate with data scientists, analysts, and other engineers to understand data requirements. Optimize Spark jobs for performance and cost-efficiency. Ensure code quality through unit testing, integration testing, and code reviews. Work with large-scale datasets in distributed environments (e.g., Hadoop, AWS EMR, Databricks). Monitor and troubleshoot production systems and pipelines. Experience in Agile Development Process. Experience in leading a 3-5 member team on the technology front Excellent communication skills, problem solving and debugg...

Design and implement scalable data processing solutions usingApache SparkandJava. Develop and maintain high-performance backend services and APIs. Collaborate with data scientists, analysts, and other engineers to understand data requirements. Optimize Spark jobs for performance and cost-efficiency. Ensure code quality through unit testing, integration testing, and code reviews. Work with large-scale datasets in distributed environments (e.g., Hadoop, AWS EMR, Databricks). Monitor and troubleshoot production systems and pipelines. Experience in Agile Development Process. Excellent communication skills, problem solving and debugging and troubleshooting Skills. Mandatory Competencies Architect...

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL.

AWS data developers with 8-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Beh - Communication Big Data - Big Data - Pyspark Database - Database Programming - SQL Programming Language - Python - Apache Airflow.

One Azure backend expert (Strong SC or Specialist Senior) Should have hands-on experience of working with ADLS, ADF and Azure SQL DW Should have minimum 3 Years working experience of delivering Azure projects. Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract, Transform, Load) processes. Knowledge of data modeling and data warehousing concepts. Implement best practices for data pipelines, i...

Power Bi and AAS expert (Strong SC or Specialist Senior) Should have hands-on experience of Data Modelling in Azure SQL Data Warehouse and Azure Analysis Service Should be able to write and test Dex queries. Should be able generate Paginated Reports in Power BI Should have minimum 3 Years working experience in delivering projects in Power Bi Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract...

Azure backend expert (ADLS, ADF and Azure SQL DW)4+Yrs/Immediate Joiners only One Azure backend expert (Strong SC or Specialist Senior) Should have hands-on experience of working with ADLS, ADF and Azure SQL DW Should have minimum 3 Years working experience of delivering Azure projects. Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract, Transform, Load) processes. Knowledge of data modeling...

Power Bi and AAS expert (Strong SC or Specialist Senior) Should have hands-on experience of Data Modelling in Azure SQL Data Warehouse and Azure Analysis Service Should be able to write and test Dex queries. Should be able generate Paginated Reports in Power BI Should have minimum 3 Years working experience in delivering projects in Power Bi Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract...

Data marts using AWS services (Redshift, Aurora, RDS), Data modelling (Star schema, Snowflake),Perf tuning (compression, materialised views), Architecting scalable data warehouses using AWS Redshift, Athena,Glue, Batch analytics using Kinesis, Lambda

ETL Developer Job Title: ETL Developer FTE Location: Coimbatore Start Date: ASAP Job Summary: We are looking for an experienced ETL Developer with strong expertise in Apache Airflow , Redshift , and SQL-based data pipelines, with upcoming transitions to Snowflake . This is a contract role based in Coimbatore, ideal for professionals who can independently deliver high-quality ETL solutions in a cloud-native, fast-paced environment. Key Responsibilities: 1. ETL Design and Development: Design and develop scalable and modular ETL pipelines using Apache Airflow , with orchestration and monitoring capabilities. Translate business requirements into robust data transformation pipelines across cloud ...

Job Title: Lead Data Engineer Location: Mumbai / Pune Experience: 8+ yrs Job Summary: We are seeking a technically strong and delivery-focused Lead Engineer to support and enhance enterprise-grade data and application products under the Durables model. The ideal candidate will act as the primary technical interface for the client, ensuring high system availability, performance, and continuous improvement. This role requires a hands-on technologist with strong team management experience, cloud (AWS) expertise, and excellent communication skills to handle client interactions and drive technical decisions. Key Responsibilities: Support & Enhancement Leadership Act as the primary technical lead ...

We are seeking a highly skilled Data Architect with expertise in AWS cloud services and data integration to join our team. The ideal candidate will be responsible for architecting, designing, and implementing scalable, secure, and high-performance data solutions. This role requires close collaboration with cross-functional teams and leadership in driving technical excellence across all stages of the data lifecycle. Sr. Data Engineer (AWS Tech Stack) Location: Pune (WFO) Experience : 5+ Years Roles & Responsibilities Architect and Design: Design and implement data integration solutions using AWS services. Develop architecture blueprints and detailed documentation. Ensure solutions are scalabl...

Role Overview: You will be joining as a Data Engineer at NTT DATA in Bangalore, Karnataka (IN-KA), India (IN). You should have at least 6 years of experience in Data Engineering or a related role and be proficient in working with Snowflake, AWS Glue, Kafka, and API technologies. Your main responsibilities will include data modelling, performance tuning, query optimization, ETL job development, orchestration, and optimization. Key Responsibilities: - Hands-on experience with Snowflake including data modelling, performance tuning, query optimization, Snowpipe, Time Travel, Streams & Tasks. - Strong expertise in AWS Glue for ETL job development, orchestration, and optimization. - Proficiency wi...