988 Glue Jobs - Page 9

5+ years of relevant experience on Scala/Python (PySpark), Distributed Databases, Kafka with solid hands-on multi-threading, functional programing etc. A good understanding of CS Fundamentals, Data Structures, Algorithms and Problem Solving. Professional hand-on experience in Sql and Query Optimization. Experience in building frameworks for data ingestions and consumptions patterns. Expertise with GCP cloud and GCP data processing tools, platforms and technologies like GCS, DataProc, DPaaS, BigQuery, Hive etc. aws, glue, devops, pyspark ETL, pipeline, AWS, glue AWS, AI, python, etl

5+ years of relevant experience on Scala/Python (PySpark), Distributed Databases, Kafka with solid hands-on multi-threading, functional programing etc. A good understanding of CS Fundamentals, Data Structures, Algorithms and Problem Solving. Professional hand-on experience in Sql and Query Optimization. Experience in building frameworks for data ingestions and consumptions patterns. Expertise with GCP cloud and GCP data processing tools, platforms and technologies like GCS, DataProc, DPaaS, BigQuery, Hive etc. aws, glue, devops, pyspark ETL, pipeline, AWS, glue AWS, AI, python, etl

Role & responsibilities AWS,Glue or DataBricks,SQL, Python,Pyspark.

3-4 years hands-on experience on AWS services, ideally SaaS in the cloud Experience developing solutions with code/scripting language must have Python experience (e.g, python, Node.js) Experience in creating and configuring AWS resources like API Gateway, CloudWatch, Cloud-Formation, EC2, Lambda, Amazon Connect, SNS, Athena, Glue, VPC etc.Sourcing & Screening US profiles Location-Delhi NCR,Bangalore,Chennai,Pune,Kolkata,Ahmedabad,Mumbai,Hyderabad ,Remote

We are seeking an experienced Amazon Redshift Developer / Data Engineer to design, develop, and optimize cloud-based data warehousing solutions. The ideal candidate should have expertise in Amazon Redshift, ETL processes, SQL optimization, and cloud-based data lake architectures. This role involves working with large-scale datasets, performance tuning, and building scalable data pipelines. Key Responsibilities: Design, develop, and maintain data models, schemas, and stored procedures in Amazon Redshift. Optimize Redshift performance using distribution styles, sort keys, and compression techniques. Build and maintain ETL/ELT data pipelines using AWS Glue, AWS Lambda, Apache Airflow, and dbt. ...

We are seeking an experienced PySpark Developer / Data Engineer to design, develop, and optimize big data processing pipelines using Apache Spark and Python (PySpark). The ideal candidate should have expertise in distributed computing, ETL workflows, data lake architectures, and cloud-based big data solutions. Key Responsibilities: Develop and optimize ETL/ELT data pipelines using PySpark on distributed computing platforms (Hadoop, Databricks, EMR, HDInsight). Work with structured and unstructured data to perform data transformation, cleansing, and aggregation. Implement data lake and data warehouse solutions on AWS (S3, Glue, Redshift), Azure (ADLS, Synapse), or GCP (BigQuery, Dataflow). Op...

Skills Required Experience in designing and building a serverless data lake solution using a layered components architecture including Ingestion, Storage, processing, Security & Governance, Data cataloguing & Search, Consumption layer. Hands on experience in AWS serverless technologies such as Lake formation, Glue, Glue Python, Glue Workflows, Step Functions, S3, Redshift, Quick sight, Athena, AWS Lambda, Kinesis. Must have experience in Glue. Experience in design, build, orchestration and deploy multi-step data processing pipelines using Python and Java Experience in managing source data access security, configuring authentication and authorisation, enforcing data policies and standards. Ex...

Job Description We are looking for an experienced Senior Data Engineer with a strong foundation in Python, SQL, and Spark , and hands-on expertise in AWS, Databricks . In this role, you will build and maintain scalable data pipelines and architecture to support analytics, data science, and business intelligence initiatives. Youll work closely with cross-functional teams to drive data reliability, quality, and performance. Responsibilities: Design, develop, and optimize scalable data pipelines using Databricks in AWS such as Glue, S3, Lambda, EMR, Databricks notebooks, workflows and jobs. Building data lake in WS Databricks. Build and maintain robust ETL/ELT workflows using Python and SQL to ...

We are looking for a highly motivated Engineering Lead Cloud and Data Engineer to lead the development of scalable, cloud-native data solutions. This role demands both strong technical expertise and leadership capabilities to ensure seamless integration of cloud technologies with modern data engineering practices. Key Responsibilities: Lead the architecture, design, and implementation of cloud-native data engineering solutions on platforms like AWS. Orchestrate integration of applications and data sources across multi-cloud or hybrid cloud environments. Design and implement automated data pipelines using tools like Apache Spark and cloud-native services (AWS Glue, EMR, etc.). Collaborate wit...

About the Opportunity Job Type: Permanent Application Deadline: 30 September 2025 Title Senior Data Engineer II Department ISS Location Bengaluru Reports To Data Engineers - Lead Level 6 We share a commitment to making things better for clients and each other. We continually explore new technology and different ways of working to put our clients first. So, bring your boldest ideas to our (name of team/business area) team and feel like you are making progress. About your team ISS Data Engineering Chapter is an engineering group comprised of three sub-chapters - Data Engineers, Data Platform and Data Visualisation - that supports the ISS Department. Fidelity is embarking on several strategic p...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Advanced knowledge of AWS Services/Architecture Experience in AWS Compute such as EC2, Lambda, Beanstalk, Batch or ECS Experience with AWS Storage services such as: S3, EFS, Glacier. Experience in AWS Management and Governance suite of products such as CloudTrail , CloudWatch Experience in AWS Analytics such as Athena, EMR , Glue, Redshift, Kinesis Strong knowledge in Python object-oriented programming Strong experience with AWSDatabase services such as : RDS, DynamoDB Experience using APIs for developing or programming software Experience using AWS Application Integration Services such as: Simple Notification Service ( SNS ), Simple Queue Service ( SQS ), Step Functions . Experience with AW...

Database Development & Management Strong experience in SQL development and query optimization. Hands-on experience with Snowflake (preferred), Oracle, or any relational database. Understanding of database indexing, partitioning, and performance tuning. . ETL/ELT Development Expertise in ETL/ELT development, preferably using Talend (or any other ETL tool). Strong proficiency in Advanced SQL scripting for data transformation and processing. Ability to design, develop, and optimize data pipelines for structured/unstructured data. Experience in error handling, logging, and recovery mechanisms for ETL processes. Data Warehousing & Modeling Understanding of Data Warehousing concepts, including Sta...

As an AWS expert with over 10 years of experience, you will be responsible for setting up, configuring, and integrating API gateways in AWS. Your proficiency in API frameworks, XML/JSON, REST, and data protection will be crucial for software design, build, test, and documentation. You should have hands-on experience with various AWS services such as Lambda, S3, CDN (CloudFront), SQS, SNS, EventBridge, API Gateway, Glue, and RDS. In this role, you will be expected to articulate and implement projects using these AWS services effectively. Your expertise will play a significant role in improving business processes through the development of integration solutions. This position requires immediat...

We are looking for an accomplished and hands-on Senior AI Lead to drive the development and deployment of AI-powered solutions for supply chain optimization. This senior technical leadership role requires deep AI/ML expertise, client-facing engagement, and team management to deliver intelligent, scalable products on the AWS cloud platform. You will be responsible for leading the end-to-end lifecycle of AI solutions that address real-world supply chain challenges such as demand planning and forecasting, inventory optimization, purchasing, fulfillment, route planning, risk prediction, and anomaly detection. Your key responsibilities will include designing, building, and deploying AI/ML models ...

As an IT Application Architect at TaskUs, you will have the opportunity to design and develop web-based services for our Ridiculously Awesome applications. You will be responsible for creating scalable applications with a high sense of ownership and a commitment to industry best practices. Your role will involve application design, development, and deployment, as well as providing technical guidance and leadership to a team of .NET & NodeJS developers. Your expertise in architecting solutions and collaborating with business stakeholders to deliver requirements will be crucial in this role. Key Responsibilities: - Implement .NET & NodeJS Application solutions in an enterprise setting. - Devel...

With over 6 years of experience and immediate availability for joining, you will be supporting UK clients during the work timings from 1 PM to 10 PM at Gurugram location. As an AWS ETL developer with 5-8 years of experience, you will play a crucial role in handling all data-related tasks. Your proficiency in AWS cloud services such as EC2, IAM, KMS keys, AWS Lambda, Batch, Terraform/CFT, Event bridge, and Managed Kafka, Kinesis, Glue, and PySpark will be essential for this position. A strong grasp of data modeling concepts is a prerequisite for excelling in this role. You must be well-versed in Python and other programming languages. Additionally, familiarity with various SQL/NOSQL data stor...

You are invited to join Carelon Global Solutions India as a Team Lead I (IND) in Bangalore. Carelon Global Solutions is a part of Elevance Health, a renowned healthcare company in America dedicated to improving lives and communities. As a Team Lead, you will be responsible for all design requirements for leader communications, reporting to the Manager Communications. Your main duties will include understanding the design process, liaising with stakeholders, and coordinating with external agencies to ensure brand guidelines are followed. To excel in this role, you should possess the following qualifications and skills: Qualifications: - B.Tech / B.E / MCA Experience: - 5+ years of experience ...

About the Role: 09 Grade Level (for internal use): 09 The Team: The Digital Technology Services Platforms & Tools (DTS P&T) is responsible for developing and managing tools enabling Service Management, Agile Execution, Project Portfolio Management, DevOps Tools and DTS BI, for all the S&P Global Divisions. The P&T team is spread across 5 major verticals as mentioned above and is responsible for managing close to 30 different Products in the above-mentioned domains for the S&P Global Enterprise. The Impact: Are you looking for an opportunity to advance your career as an innovative enterprise team member The Platforms and Tools Team is looking for an innovative professional who can bring teamw...

The role of Senior Data Engineer involves designing, building, and maintaining ETL/ ELT pipelines. You will be responsible for integrating data from various sources to generate comprehensive insights. Additionally, you will manage Data warehouse solutions, design data models, create ETL processes, and ensure data quality. Performing exploratory data analysis to troubleshoot issues and collaborating with clients is also part of your responsibilities. Mentoring junior team members and offering guidance will be expected from you. In terms of technical skills, proficiency in Python, Pyspark, SQL, Data Warehouse, ETL, Data Modelling, and building ETL Pipelines is crucial. Hands-on experience with...

As an ETL Developer with our team, you will be responsible for a range of tasks including enhancements, new development, defect resolution, and production support of ETL development utilizing AWS native services. Your expertise will be crucial in integrating data sets through AWS services such as Glue and Lambda functions. Additionally, you will be utilizing AWS SNS for sending emails and alerts, authoring ETL processes using Python and PySpark, and monitoring ETL processes using CloudWatch events. Your role will also involve connecting with various data sources like S3, validating data using Athena, and implementing CI/CD processes using GitHub Actions. Proficiency in Agile methodology is e...

Job Title :AWS Data Engineer Location :Bangalore Notice Period : Immediate to 60 Days Preferred. Job Description: We are seeking skilled and dynamic Cloud Data Engineers specializing in AWS, Databricks. The ideal candidate will have a strong background in data engineering, with a focus on data ingestion, transformation, and warehousing. They should also possess excellent knowledge of PySpark or Spark, and a proven ability to optimize performance in Spark job executions. Key Responsibilities: - Design, build, and maintain scalable data pipelines for a variety of cloud platforms including AWS. - Implement data ingestion and transformation processes to facilitate efficient data warehousing. - U...

Ready to shape the future of work At Genpact, we don&rsquot just adapt to change&mdashwe drive it. AI and digital innovation are redefining industries, and we&rsquore leading the charge. Genpact&rsquos , our industry-first accelerator, is an example of how we&rsquore scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to , our breakthrough solutions tackle companies most complex challenges. If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that&rsquos shaping the future, this is your moment. Genpact (NYSE: G) is an advanced technology ...