1333 Aws Glue Jobs - Page 26

What would a typical day at your work be like? Design, build, and maintain robust data pipelines using Snowflake, DBT, AWS Glue, Python, SQL, Fivetran, and Snaplogic. Work closely with team leads to deliver high-quality and scalable data solutions. Implement data ingestion, transformation, and integration from diverse sources. Optimize SQL queries and ensure performance tuning for large-scale datasets. Collaborate with data scientists to integrate ML workflows into data pipelines. Ensure data quality, documentation, and adherence to project standards. What Do We Expect? 3 to 9 years of hands-on experience in data engineering. Strong expertise in Snowflake and DBT for transformation and orche...

Responsibilities: 5+ years of hands-on experience in data engineering , particularly with Python , PySpark , and SQL . Proven experience building ETL pipelines using AWS services (Glue, Lambda, S3, Athena, Step Functions). Strong knowledge of Data Warehousing concepts , SCD Types (Type 1, Type 2) , and Medallion Architecture . Solid understanding of data modeling , partitioning , and performance optimization in big data environments. Excellent communication skills with the ability to explain technical topics to non-technical stakeholders. Nice-to-Have Skills: Experience with DBT for data transformation and testing. Hands-on exposure to Databricks and the Lakehouse architecture . Familiarity ...

We are conducting a Walk-In Interview in Hyderabad for the position of Data Engineering on 5th/6th/7th September 2025. Note: Candidates who attended interview with us last 6 months are not eligible. Position: Data Engineering Job description: Expert knowledge in AWS Data Lake implementation and support (S3, Glue,DMS Athena, Lambda, API Gateway, Redshift) Handling of data related activities such as data parsing, cleansing quality definition data pipelines, storage and ETL scripts Experiences in programming language Python/Pyspark/SQL Experience with data migration with hands-on experience Experiences in consuming rest API using various authentication options with in AWS Lambda architecture or...

As an ETL Automation Test Engineer with expertise in Python development, ETL testing, and CI/CD implementation, you will play a crucial role in automating manual ETL processes using Python scripting. Your primary focus will be on designing, developing, and executing ETL test cases and scripts to ensure the validation of data pipelines. You will be responsible for performing data validation, reconciliation, and integrity checks across various source and target systems. Your role will involve implementing Python-based test automation frameworks for ETL workflows and integrating automated ETL tests into CI/CD pipelines to facilitate seamless deployments. You will collaborate closely with Data E...

You have an exciting opportunity as an Associate Technical Architect-AWS with 8-10 years of experience. As an Associate Technical Architect-AWS, you will be responsible for working with AWS Architect, AWS Glue or Databricks, PySpark, and Python. Your role will involve hands-on experience with AWS Glue or Databricks, PySpark, and Python, with a minimum of 2 years of expertise in PySpark and AWS Cloud. Additionally, you will be expected to have hands-on experience in StepFunction, Lambda, S3, Secret Manager, Snowflake/Redshift, RDS, Cloudwatch, and proficiency in crafting low-level designs for data warehousing solutions on AWS cloud. Your proven track record in implementing big-data solutions ...

About Delta Tech Hub: At Delta Air Lines, we are the global leader in safety, innovation, reliability, and customer experience. Our dedicated employees have been instrumental in maintaining our position as an industry leader for over a decade. We are committed to connecting people and cultures worldwide, fostering understanding, and contributing to social good. The Delta Technology Hub plays a crucial role in achieving our long-term goals by delivering innovative and high-value solutions, supporting various teams and functions across Delta, and enhancing customer experiences globally. The Customer Experience (CX) organization is focused on providing exceptional service that embodies the Delt...

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better for people – we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Lead Consultant-Data Engineer, AWS+Python, Spark, Kafka for ETL! Responsibilities Develop, deploy, and manage ETL...

Job Title: Data Platform Engineer Location: Mumbai (Onsite) Engagement: 12+ Months with high possibility of extensions Strong Software Engineering Skills Solid programming expertise, especially in Python, with strong fundamentals in computer science, data structures, algorithms, and system design. Proven problem-solving ability with a focus on writing clean, maintainable, and efficient code. Deep Understanding of Data Platforms Strong conceptual and practical understanding of end-to-end data platform architecturefrom ingestion to transformation to consumption. Hands-on experience building and scaling data platforms in production environments. Expertise in AWS Ecosystem In-depth knowledge and...

Role & responsibilities Primary Skill GenAI AI ML projects or initiatives 30% Proficiency in Snowflake 70% Secondary Skill Python , SQL and AWS data services LLMs embeddings ,vector databases, NLP SONIYA soniya05.mississippiconsultants@gmail.com

Job Title: Lead Data Engineer Location: Mumbai / Pune Experience: 8+ yrs Job Summary: We are seeking a technically strong and delivery-focused Lead Engineer to support and enhance enterprise-grade data and application products under the Durables model. The ideal candidate will act as the primary technical interface for the client, ensuring high system availability, performance, and continuous improvement. This role requires a hands-on technologist with strong team management experience, cloud (AWS) expertise, and excellent communication skills to handle client interactions and drive technical decisions. Key Responsibilities: Support & Enhancement Leadership Act as the primary technical lead ...

As a skilled professional in the field of cloud computing and data engineering, you will be responsible for a variety of tasks related to managing data assets, developing ETL pipelines, and exploring machine learning capabilities. Your expertise in technologies such as Git, Kubernetes, Docker, and Helm will be essential in ensuring the smooth functioning of cloud infrastructure on platforms like AWS and Azure. Your role will involve the evaluation and analysis of data using tools like AWS QuickSight, as well as the deployment of machine learning models through AWS MLOps. Proficiency in AWS services such as Glue, QuickSight, SageMaker, Lambda, and Step Functions will be crucial for success in...

UnifyCX is looking for a highly experienced Senior Data Scientist to join the team. As a Senior Data Scientist, you will be responsible for developing and implementing complex statistical models and machine learning algorithms to support data-driven decision-making processes. This role involves leading data analysis projects, collaborating with cross-functional teams, and identifying key business insights, trends, and opportunities. We believe that data transformation and integration play a crucial role in generating business insights. Therefore, we are seeking a Senior Data Scientist with experience in automating data pipelines to ensure proper data transformation and integration for analyt...

As a software development partner for a large enterprise financial products and services firm listed on NYSE, you were involved in re-architecting and migrating 30-year legacy systems to cloud-based microservices on AWS. These systems are crucial for their trading, journal, and bookkeeping platforms. Your contributions included developing an event-driven ETL pipeline using AWS services to transfer end-of-day securities data from the mainframe to a relational database. You also built highly resilient and available containerized microservices to ensure smooth operations. In addition, you automated build and deployment processes using Jenkins and Terraform across various environments such as Sa...

As a Lead Data Engineer with over 7 years of experience, you will be responsible for designing, developing, and maintaining data pipelines, ETL processes, and data warehouses. You will be based in Hyderabad and should be able to join immediately. Your primary skills should include proficiency in SQL, Python, PySpark, AWS, Airflow, Snowflake, and DBT. Additionally, you should have a Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field. In this role, you will need a minimum of 4+ years of hands-on experience in data engineering, ETL, and data warehouse development. You should have expertise in ETL tools such as Informatica Power Center or IDMC...

Job Title: AWS Data Engineer Location: Gurgaon, (Onsite) Interview Process: Face to Face About the Role: We are looking for a skilled AWS Data Engineer with hands-on experience in AWS Glue and other AWS analytics services. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes that support data ingestion, transformation, and loading for advanced analytics and business intelligence. Key Responsibilities: Design and develop ETL pipelines using AWS Glue , PySpark , and other AWS services (Lambda, Step Functions, S3, etc.) Build and maintain scalable data lakes and data warehouses using AWS S3 , Athena , Redshift , and Glue Da...

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better for people – we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Lead Consultant-Data Engineer, AWS+Python, Spark, Kafka for ETL! Responsibilities Develop, deploy, and manage ETL...

My linkedin linkedin.com/in/yashsharma1608. contract period - 6-12month payroll will be - ASV consulting , my company client - will disclose after 1 round Job location - Gurgaon - onsite(WFO) budget - upto 1lpa/month , depending on last (relevant hike) Exprnce - 3+ JD is About the Role We are looking for a skilled AWS Data Engineer with strong hands-on experience in AWS Glue and AWS analytics services. The candidate will be responsible for designing, building, and optimizing scalable data pipelines and ETL processes that support advanced analytics and business intelligence requirements. Key Responsibilities Design and develop ETL pipelines using AWS Glue, PySpark, and AWS services (Lambda, S...

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better for people – we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Lead Consultant-Data Engineer, AWS+Python, Spark, Kafka for ETL! Responsibilities Develop, deploy, and manage ETL...

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better for people – we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Lead Consultant-Data Engineer, AWS+Python, Spark, Kafka for ETL! Responsibilities Develop, deploy, and manage ETL...

Position Overview We are seeking a highly skilled Senior Data Engineer to join our data platform team, responsible for designing and implementing scalable, cloud-native data solutions. This role focuses on building modern data infrastructure using AWS and Azure services to support our growing analytics and machine learning initiatives. Key Responsibilities Business Translation : Collaborate with business stakeholders to understand requirements and translate them into scalable data models, architectures, and robust end-to-end data pipelines ETL/ELT Implementation : Design, develop, and maintain high-performance batch and real-time data pipelines using modern frameworks like Apache Spark, Delt...

Roles and responsibilities Design AWS architectures based on business requirements. Create architectural diagrams and documentation. Present cloud solutions to stakeholders. Skills and Qualifications: Design, develop, and maintain scalable ETL/ELT pipelines using AWS services like Glue, Lambda, and Step Functions. Work with batch and real-time data processing using AWS Glue, Kinesis, Kafka, or Apache Spark. Optimize data pipelines for performance, scalability, and cost-effectiveness. Identify bottlenecks and optimize query performance on Redshift, Athena, and Glue. Strong knowledge of AWS services: EC2, S3, RDS, Lambda, IAM, VPC, CloudFormation, CloudWatch, etc. Experience with serverless ar...

Required Skills and Experience 8 to 10 years of experience in data engineering or backend development in cloud-based environments. Strong Python development experience, with emphasis on Pyspark for data transformation and parsing. Proficiency with PySpark for distributed data processing. Deep understanding of SQL, with hands-on experience in MySQL, PostgreSQL, or Snowflake. Strong experience with AWS services, especially: AWS Lambda and API Gateway for API development AWS Glue for orchestration and transformation Amazon S3, RDS, and ECS for data storage and compute Experience developing and managing RESTful APIs. Experience implementing and managing CI/CD pipelines. Hands-on experience with ...

As a PySpark Data Engineer at Viraaj HR Solutions, you will be an integral part of our dynamic team in India. Your primary responsibility will be to design, develop, and maintain robust data pipelines using PySpark. You will play a crucial role in implementing ETL processes for data extraction, transformation, and loading, while ensuring data quality from structured and unstructured sources. Your expertise in optimizing data processing workflows will be essential for enhancing performance and efficiency. Collaboration with data scientists and analysts is key to understanding data requirements and creating data warehousing solutions for end-user access. You will integrate data from various so...

As a Data Engineering Lead, you will be responsible for developing and implementing data engineering projects, including enterprise data hubs or Big data platforms. Your role will involve defining reference data architecture, leveraging cloud-native data platforms in AWS or Microsoft stack, and staying updated on the latest data trends like data fabric and data mesh. You will play a key role in leading the Center of Excellence (COE) and influencing client revenues through innovative data and analytics solutions. Your responsibilities will include guiding a team of data engineers, overseeing the design and deployment of data solutions, and strategizing new data services and offerings. Collabo...

We are searching for a highly skilled and seasoned Senior ETL & Data Streaming Engineer with over 10 years of experience to take on a crucial role in the design, development, and maintenance of our robust data pipelines. The ideal candidate will possess in-depth expertise in batch ETL processes as well as real-time data streaming technologies, along with extensive hands-on experience with AWS data services. A proven track record of working with Data Lake architectures and traditional Data Warehousing environments is a must. Your responsibilities will include designing, developing, and implementing highly scalable, fault-tolerant, and performant ETL processes using leading ETL tools to extrac...