1547 Glue Jobs

ETL QA professional with over 7 years of experience in ETL testing across platforms such as Oracle, Snowflake, and Starburst Skilled in leveraging AWS services including S3 Buckets, Glue Jobs, Lambda functions, and DAGs for data validation and pipeline testing Experienced in verifying data integrations with Golden Source and associated systems Proficient in Python, Excel Macros, and VB scripting, with a solid understanding of Security and Rating Mastering domains (preferred)

Collaborate with big data engineers to validate data pipelines and ensure data integrity across ingestion, processing, and transformation stages. Write complex PySpark and SQL queries to test and validate large-scale datasets. Perform ETL testing , covering schema validation, data completeness, accuracy, transformation logic, and performance testing. Conduct root cause analysis of data issues using structured debugging approaches. Build automated test scripts in Python for regression, smoke, and end-to-end data testing. Analyze large datasets to track KPIs and performance metrics supporting business operations and strategic decisions. Work with data analysts and business teams to translate b...

Design and implement data architecture and pipelines using PySpark, Python, and AWS services (Glue, EMR, S3, Redshift, Athena). Modernize legacy systems by converting Java-based migration or ETL scripts into Spark-based solutions. Build and manage data lakes and data warehouses optimized for analytics and AI/ML workflows. Collaborate with data scientists and analysts to enable model training, deployment, and continuous data delivery. Define and document HLD (High-Level Design) and LLD (Low-Level Design) for scalable data systems. Implement standards for data quality, governance, performance optimization, and security. Lead troubleshooting, performance tuning, and architecture reviews for dat...

Strong expertise in Python (including data processing/manipulation libraries such as pandas, PySpark). Hands-on experience in designing and maintaining ETL pipelines. Proficiency with AWS cloud services (Glue, Lambda, EMR, ECS, Lake Formation, etc.). Experience with orchestration tools such as Airflow and AWS Step Functions. Exposure to databases like Redshift, Aurora, Postgres, or Snowflake.

Strong expertise in Python (including data processing/manipulation libraries such as pandas, PySpark). Hands-on experience in designing and maintaining ETL pipelines. Proficiency with AWS cloud services (Glue, Lambda, EMR, ECS, Lake Formation, etc.). Experience with orchestration tools such as Airflow and AWS Step Functions. Exposure to databases like Redshift, Aurora, Postgres, or Snowflake.

Strong expertise in Python (including data processing/manipulation libraries such as pandas, PySpark). Hands-on experience in designing and maintaining ETL pipelines. Proficiency with AWS cloud services (Glue, Lambda, EMR, ECS, Lake Formation, etc.). Experience with orchestration tools such as Airflow and AWS Step Functions. Exposure to databases like Redshift, Aurora, Postgres, or Snowflake.

Role & responsibilities Design, develop, and maintain scalable and efficient data pipelines for batch and real-time processing. Work extensively with Databricks and PySpark to process and transform large datasets. Write complex and optimized SQL queries for data extraction, transformation, and analysis. Develop robust ETL/ELT processes to integrate data from various structured and unstructured sources. Collaborate with data scientists, analysts, and business stakeholders to ensure reliable and accessible data. Implement best practices for data quality, governance, and security on the AWS cloud platform. Monitor and troubleshoot data workflows to ensure high availability and performance. Cont...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. You should have Data Engineering experience with strong Python programming skills and hands-on experience in building and maintaining data pipelines on AWS...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. You should have Data Engineering Lead with extensive experience in Python, AWS, and large-scale data platform design. This role requires strategic thinki...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. You should have Data Engineering experience with strong Python programming skills and hands-on experience in building and maintaining data pipelines on AWS...

Key Responsibilities: Use data mappings and models provided by the data modeling team to build robust Snowflake data pipelines . Design and implement pipelines adhering to 2NF/3NF normalization standards . Develop and maintain ETL processes for integrating data from multiple ERP and source systems . Build scalable and secure Snowflake data architecture supporting Data Quality (DQ) needs. Raise CAB requests via Carriers change process and manage production deployments . Provide UAT support and ensure smooth transition of finalized pipelines to support teams. Create and maintain comprehensive technical documentation for traceability and handover. Collaborate with data modelers, business stakeh...

Design, develop, and maintain full stack web applications using .NET (Core) or Python for back-end services Angular (v10 or above AWS services such as: Lambda, API Gateway, EC2, S3, CloudFormation, DynamoDB, RDS, CloudWatch, Cognito, and SNS/SQS

Job Description Python Lead Developer (Contract Position) Location : Chennai Hybrid (3 Days a Week in Office) Experience : 8 - 10 Years Employment Type : Contract Shift : UK Shift (if applicable) Job Summary We are looking for a highly skilled Python Lead Developer with strong expertise in Python, SQL, AWS, and Apache Airflow. The ideal candidate will lead a team of developers to build scalable data pipelines, backend systems, and cloud-based solutions, ensuring high performance, maintainability, and adherence to best practices. Key Responsibilities Lead and mentor a team of Python developers, ensuring delivery of high-quality software solutions. Design, develop, and optimize data pipelines ...

Greetings from TCS! Job Title: Azure Data Engineer Required Skillset: AWS(preferable)/AZURE Databricks Location: PAN INDIA Experience Range: 5-14 years Job Description: Must Have: Experience: More than 4 years in data integration, pipeline development, and data warehousing, with a strong focus on AWS/AZURE Databricks. Proficiency in Databricks platform, management, and optimization. Strong experience in AWS/AZURE Cloud, particularly in data engineering and administration, with expertise in Apache Spark/Azure Synapse Analytics Spark pool, S3, Athena, Glue/AZURE Data factory, Kafka, Lambda/Azure functions, Redshift, and RDS. Proven experience in data engineering performance tuning and analytic...

Join us as a Service Operations Manager at Barclays, where you'll take part in the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. As a part of the Service Operations team, you will deliver technology stack, using strong analytical and problem solving skills to understand the business requirements and deliver quality solutions. You'll be working on complex technical problems that will involve detailed analytical skills and analysis. This will be done in conjunction with fellow engineers, business analysts and business stakeholders. To be successful...

Role & responsibilities Total Experience of 4-8years Hands on experience in python coding is must . Experience in data engineering which includes laudatory account Hands-on experience in Big Data cloud platforms like AWS(redshift, Glue, Lambda), Data Lakes, and Data Warehouses, Data Integration, data pipeline. Experience in SQL, writing code in spark engine using python,pyspark.. Experience in data pipeline and workflow management tools ( such as Azkaban, Luigi, Airflow etc.) Key Personal Attributes Business focused, Customer & Service minded Strong Consultative and Management skills Good Communication and Interpersonal skills Preferred candidate profile Interested Candidate Share your CV on...

Roles & Responsibilities Job Description Sr. Data Engineer We are looking for a Senior Data Engineering who will be majorly responsible for designing, building and maintaining ETL/ ELT pipelines. Integration of data from multiple sources or vendors to provide the holistic insights from data. You are expected to build and manage Data warehouse solutions, designing data models, creating ETL processes, implementing data quality mechanisms etc. Performs EDA (exploratory data analysis) required to troubleshoot data related issues and assist in the resolution of data issues. Should have experience in client interaction. Experience in mentoring juniors and providing required guidance. Required Tech...

Experience : 4.00 + years Salary : Confidential (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Beige Bananas) (*Note: This is a requirement for one of Uplers client - Beige Bananas) What do you need for this opportunity Must have skills required: Databrick, Vector, LLM, rag, NLP, Python Beige Bananas is Looking for: Job Title : Senior Data Scientist Company name : Beige Bananas Job location: India (Remote), Mumbai , Bangalore Job Description Company Description Beige Bananas is a rapidly growing pure play AI consulting firm that speci...

Experience : 4.00 + years Salary : Confidential (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Beige Bananas) (*Note: This is a requirement for one of Uplers client - Beige Bananas) What do you need for this opportunity Must have skills required: Databrick, Vector, LLM, rag, NLP, Python Beige Bananas is Looking for: Job Title : Senior Data Scientist Company name : Beige Bananas Job location: India (Remote), Mumbai , Bangalore Job Description Company Description Beige Bananas is a rapidly growing pure play AI consulting firm that speci...

Experience : 4.00 + years Salary : Confidential (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Beige Bananas) (*Note: This is a requirement for one of Uplers client - Beige Bananas) What do you need for this opportunity Must have skills required: Databrick, Vector, LLM, rag, NLP, Python Beige Bananas is Looking for: Job Title : Senior Data Scientist Company name : Beige Bananas Job location: India (Remote), Mumbai , Bangalore Job Description Company Description Beige Bananas is a rapidly growing pure play AI consulting firm that speci...

Spark, Kafka with multiple complex cloud implementation exp.

Role & responsibilities: We are looking for an experienced Data Engineering Manager with strong hands-on expertise in AWS cloud data services, Python, SQL, and PySpark . The ideal candidate will lead the design, development, and deployment of scalable data pipelines, data lakes, and data warehouse solutions using AWS technologies. This role requires strong technical leadership, project management, and stakeholder collaboration to deliver high-quality data solutions for analytics and business intelligence. Preferred candidate profile: Lead and manage a team of data engineers to design, build, and optimize ETL pipelines using AWS Glue, PySpark, and SQL . Develop and maintain data lakes, data m...

Role & responsibilities: We are looking for an experienced Data Engineering Manager with strong hands-on expertise in AWS cloud data services, Python, SQL, and PySpark . The ideal candidate will lead the design, development, and deployment of scalable data pipelines, data lakes, and data warehouse solutions using AWS technologies. This role requires strong technical leadership, project management, and stakeholder collaboration to deliver high-quality data solutions for analytics and business intelligence. Preferred candidate profile: Lead and manage a team of data engineers to design, build, and optimize ETL pipelines using AWS Glue, PySpark, and SQL . Develop and maintain data lakes, data m...

Role: Solutions Architect - AWS Data and Analytics GTM Experience: 8+ Years, Minimum 5 years on AWS Work location: Mumbai/Bangalore/ Trivandrum (Hybrid) Responsibilities Be a trusted technical advisor to customers and solutions for complex Cloud & Data related technical challenges. Be a thought leader in architecture design and development of cloud data analytics solutions. Liaison with internal and external stakeholders to design optimized data analytics solutions on AWS cloud Partner with SMEs and Solutions Architects from leading cloud providers to present solutions to customers Support Quantiphi Sales and GTM teams from a technical perspective in building proposals and SOWs Lead discover...

Job Title: Data Engineer Location: Puttaparthi, Andhra Pradesh (On-site) Experience Level: 4-8 years About the Role: We are seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure across AWS and Azure platforms. The role requires hands-on expertise in Python, SQL, and cloud-native services to ensure data integrity, security, and performance across our data ecosystem. Key Responsibilities: Design, develop, and maintain robust ETL/ELT pipelines using Python and SQL . Build and manage data infrastructure on AWS and Azure cloud platforms. Optimize data storage and retrieval using cloud-native tools and services. Collaborate with cross-func...