869 Aws Glue Jobs

Big Data Engineer AWS S3, DMS, Glue, Lambda, Redshift, Python, SQL, Git, CI/CD, Agile delivery Key Responsibilities Develop and maintain ETL/ELT pipelines using AWS Glue Integrate data from source systems into Bronze and Silver layers • Build metadata-driven ingestion and processing workflows Write clean, efficient, and testable code Required Skills & Tech Stack AWS Glue (PySpark), DMS, S3, Redshift, Glue Catalog Python, SQL Git, CI/CD, Agile delivery Certifications & Other Requirements • AWS Certified Developer / Data Engineer (Associate level) • 46 years of experience Follow engineering best practices Experience working in security-compliant and time-sensitive environments Share your resum...

Azure Data Tech Lead / Sr.Azure Data Engineer Years of Exp- 6 to 8 Years Location-Chennai Work Mode- Work From Office -Chennai Shift time-UK Shift time Primary Skillset-Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL,Azure Synapse JD: Experience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key Responsibilities Design and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources. Optimize performance and scalability of data flows using tools like Apache Spark, Databricks, or AWS Glue. Collaborate with domain experts in genomics, clinical trials, and lab science to understand and implement robust data solutio...

Job Purpose and Impact The Manager, Trading Engineering job sets goals and objectives for the achievement of greenfield, brownfield and BAU work results for the product team responsible for designing, developing, and maintaining software applications and systems that drive the trading operations. This job requires strategic vision and technical leadership to manage trading engineering products and projects, implementing appropriate technologies and methodologies and adopting best in class industry standards and emerging technologies to improve the performance and capabilities of trading systems. This job also leads the trading engineering team to deliver against project planning and prioriti...

4 or more years of experience in AWS (Amazon Web Services) services like IAM, EC2, ECS, EKS, Lambda, CloudWatch, EventBridge, DynamoDB, S3, Redshift, Athena, AWS Glue. Extensive experience in developing CI/CD pipelines using Git (Github) and DevOps tools; Infrastructure as Code’ using Terraform scripts. Working experience in Restful API, Event-driven frameworks, Docker and Kubernetes containers. Excellent communication and well versed with Scrum/Agile methodology. Added Bonus If You Have AWS Foundational or Associate certification. Working experience in GCP (Google Cloud Platform) Functional knowledge of Adtech / Martech technologies Experience in enabling SSO in enterprise applications by i...

Azure Data Tech Lead / Sr.Azure Data Engineer Years of Exp- 6 to 8 Years Location-Chennai Work Mode- Work From Office -Chennai Shift time-UK Shift time Billrate- Ieyond this range) Primary Skillset-Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL,Azure Synapse JD: Experience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key Responsibilities Design and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources. Optimize performance and scalability of data flows using tools like Apache Spark, Databricks, or AWS Glue. Collaborate with domain experts in genomics, clinical trials, and lab science to understand and ...

Responsibilities: * Collaborate with cross-functional teams on data initiatives * Optimize database performance through SQL tuning * Analyze large datasets using Python, Tableau & Power BI

Job Title: Data Analytics Lead Experience: 7 to 8 Years Location: Hyderabad Role Type: Individual Contributor About the Role: We are seeking a skilled and experienced Data Analytics Specialist to join our team in Hyderabad. This is an individual contributor role focused on driving data quality, governance, and advanced analytics across a cloud-native environment. The ideal candidate should have strong technical expertise across modern data stacks, excellent problem-solving skills, and a proactive approach to managing enterprisegrade data platforms. Key Responsibilities: Design, develop, maintain data pipelines, data transformation ETL using AWS Glue, AWS EMR, AWS Kinesis, AWS Redshift, Amazo...

We are looking for an experienced Data Engineer with 4+ years of expertise in building scalable data pipelines on AWS . The ideal candidate should have strong knowledge of ETL processes , data modeling , and modern data platforms like Snowflake and Redshift . Key Skills Required: Strong hands-on experience with AWS services : EC2, S3, IAM, Glue, DMS Experience with RDBMS and MPP databases like Snowflake/Redshift Knowledge of ETL workflows and data modeling Proficiency in SQL (Python/PySpark is a plus) Good understanding of cloud-based data architecture Nice to Have: AWS certification Experience with data lake or CI/CD setup We are looking for immediate joiners only

Roles & Responsibilities: Design, develop, and optimize scalable ETL/ELT pipelines using Snowflake , AWS Glue , and dbt (Data Build Tool) . Build and maintain robust data models (star/snowflake schema) to support business intelligence and analytics use cases. Use PySpark and SQL for data processing, transformation, and querying large-scale datasets efficiently. Integrate data from various sources using AWS Lambda , APIs, and event-driven architecture where needed. Monitor and manage data pipeline performance, reliability, and cost-efficiency on the AWS cloud platform. Collaborate with data analysts, product managers, and other stakeholders to gather requirements and implement technical solut...

Role & responsibilities Design, develop, and maintain robust, scalable ETL pipelines using AWS Glue (Glue Jobs, Crawlers, Workflows). Write efficient, production-grade Python and SQL code for data extraction, transformation, and loading. Build and optimize data models for analytical and operational workloads . Integrate and manage data ingestion from multiple AWS accounts securely using cross-account roles and policies. Work with AWS services including S3, IaaS on EC2, IAM and Database migration services Collaborate with architects, analysts, and business users to understand data requirements and translate them into technical solutions. Ensure data consistency, quality, and integrity across ...

As a Data Engineering Lead with 9-15 years of experience, you will be responsible for designing, developing, and maintaining scalable data architectures and pipelines for large-scale data platforms. Your expertise in AWS and Snowflake will be crucial in building and optimizing Data Lakes, implementing real-time and batch data processing, and utilizing AWS services for efficient data integration, processing, and analytics. You will collaborate with cross-functional teams to deliver end-to-end data engineering solutions aligned with business goals. Key Responsibilities: - Design, develop, and maintain scalable data architectures and pipelines for large-scale data platforms. - Build and optimiz...

Design, develop new features for a large-scale cloud data platform using Databricks, snowflake and Fabric, Deeply understand legacy data platforms, and drive their modernization, Provide production support Design data pipelines and data warehouse. Required Candidate profile 5 years in developing and scaling data platforms using Snowflake, databricks, Fabric, Strong Python and SQL Intermediate C# Understanding of modern data architectures such as Data Mesh, Lakehouse

We are looking for AWS Data Engineer Permanent Role. Experience : 5 to10 Years Location : Hyderabad / Chennai/Noida/Pune NP-Immediate - Skills: Expertise in Data warehousing and ETL Design and implementation Hands on experience with Programming language like Python Good understanding of Spark architecture along with internals Hand on experience using AWS services like Glue (Pyspark), Lambda, S3, Athena, Experience on Snowflake is good to have Hands on experience on implementing different loading strategies like SCD1 and SCD2, Table/ partition refresh, insert update, Swap Partitions, Experience in Parallel Loading and Dependencies orchestrations Awareness of scheduling and orchestration tools...

Description:Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS.Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL.Experience with batch job scheduling and managing data dependencies.Knowledge of data processing tools like Spark and Airflow.Automate repetitive tasks and build reusable frameworks to improve efficiency.Provide Run/DevOps support and manage the ongoing operation of data services. Location - Bangalore, Mumbai, Pune, Chennai, Kolkata, Hyderabad

Immediate Joiners are preferrable Position Overview: We seek a highly skilled and experienced Data Engineering Lead to join our team. This role demands deep technical expertise in Apache Spark, Hive, Trino (formerly Presto), Python, AWS Glue, and the broader AWS ecosystem. The ideal candidate will possess strong hands-on skills and the ability to design and implement scalable data solutions, optimise performance, and lead a high-performing team to deliver data-driven insights. Key Responsibilities: Technical Leadership Lead and mentor a team of data engineers, fostering best practices in coding, design, and delivery. Drive the adoption of modern data engineering frameworks, tools, and method...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS Glue Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As part of a Data Transformation programme you will be part of the Data Marketplace team. In this team you will be responsible for Architecture and design for automating data management compliance validation, monitoring, and reporting through rule-based and AI-driven mechanisms, integrating with metadata repositories and governance tools for real-time policy enforcement and...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Role Purpose The purpose of the role is to create exceptional architectural solution design and thought leadership and enable delivery teams to provide exceptional client engagement and satisfaction. Do 1.Develop architectural solutions for the new deals/ major change requests in existing deals Creates an enterprise-wide architecture that ensures systems are scalable, reliable, and manageable. Provide solutioning of RFPs received from clients and ensure overall design assurance Develop a direction to manage the portfolio of to-be-solutions including systems, shared infrastructure services, applications in order to better match business outcome objectives Analyse technology environment, enter...

Responsibilities: Design, develop & maintain ETL processes using Python, SQL & Spark. Optimize performance through AWS Glue & Amazon Redshift. Collaborate with cross-functional teams on DBT framework implementation.

Responsibilities: * Design, develop & maintain data pipelines using AWS Glue & Python * Collaborate with cross-functional teams on data projects * Optimize performance & ensure data accuracy

Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS. Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL. Experience with batch job scheduling and managing data dependencies. Knowledge of data processing tools like Spark and Airflow. Automate repetitive tasks and build reusable frameworks to improve efficiency. Provide Run/DevOps support and manage the ongoing operation of data services. (Immediate Joiners). Location - Bengaluru,Mumbai,Pune,Chennai,Kolkata,Hyderabad.

Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS. Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL. Experience with batch job scheduling and managing data dependencies. Knowledge of data processing tools like Spark and Airflow. Automate repetitive tasks and build reusable frameworks to improve efficiency. Provide Run/DevOps support and manage the ongoing operation of data services. (Immediate Joiners).

Job Description: We are hiring Python Developers across multiple levels to build and scale modern applications. The role involves working on backend systems, microservices, and data platforms while collaborating with cross-functional teams. Responsibilities: Design, develop, and optimize scalable backend systems using Python or C#. Implement and manage microservices architecture with FastAPI, Kafka, PostgreSQL, and Redis. Work with modern data stacks (DBT, Snowflake, AWS Glue). Collaborate with product and engineering teams for solution design and delivery. Ensure system performance, reliability, and scalability. Required Skills: Strong hands-on experience in Python or C#, FastAPI, Kafka, Po...