Manager -Data Engineer (AWS, Python, Spark, Databricks for ETL - Agentic AI!

0 years

0 Lacs

Posted:3 weeks ago| Platform: Foundit logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Manager -Data Engineer (AWS, Python, Spark, Databricks for ETL - Agentic AI!

In this role, you%27ll be part of Genpact%27s transformation under GenpactNext, as we lead the shift to Agentic AI Solutions-domain-specific, autonomous systems that redefine how we deliver value to clients. You%27ll help drive the adoption of innovations like the Genpact AP Suite in finance and accounting, with more Agentic AI products set to expand across service lines.

Responsibilities

  • AWS Glue

  • Manage releases, Oversee testing, PoCs , including cost evaluations, of various AWS services and other tools, AWS, Python, Spark, Databricks for ETL-Agentic AI, Strong experience in Python and SQL , Proven expertise in AWS services such as S3, Lambda, Glue, EMR, and Redshift. Strong understanding of security principles and best practices for cloud-based environments.

  • AWS Lambda

  • Databricks

  • IAM roles

  • AWS Glue

  • data pipeline performance

  • Contribute in the design and review of technical solutions, translating business requirements and user stories into scalable data engineering architectures.

  • Conduct unit testing and data validation to ensure functional correctness of pipelines before deployment.

  • Contribute to production deployment and collaborate with release management to ensure seamless delivery of data solutions.

  • Recommend cost-effective, secure, and high-performing cloud-based data solutions, reducing manual overhead and operational burden.

Qualifications we seek in you!

Minimum Qualifications

  • Experience in designing, implementing data pipelines, build data applications, data migration on AWS

  • Strong experience of implementing data lake using AWS services like Glue, Lambda, Step, Redshift

  • Experience of Databricks will be added advantage

  • Strong experience in Python and SQL

  • Proven expertise in AWS services such as S3, Lambda, Glue, EMR, and Redshift.

  • Advanced programming skills in Python for data processing and automation.

  • Hands-on experience with Apache Spark for large-scale data processing.

  • Proficiency in SQL for data querying and transformation.

  • Strong understanding of security principles and best practices for cloud-based environments.

  • Experience with monitoring tools and implementing proactive measures to ensure system availability and performance.

  • Excellent problem-solving skills and ability to troubleshoot complex issues in a distributed, cloud-based environment.

  • Strong communication and collaboration skills to work effectively with cross-functional teams.

Preferred Qualifications/ Skills

  • Bachelor's degree in business information systems (IS), computer science or related field, or equivalent-related IT experience.

  • AWS Data Engineering & Cloud certifications, Databricks certifications

  • Familiar with multiple data integration technologies and cloud platforms

  • Knowledge of Change & Incident Management process


Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Genpact logo
Genpact

Business Consulting and Services

New York NY

RecommendedJobs for You

gurgaon, haryana, india

mumbai, maharashtra, india

mumbai, maharashtra, india

bengaluru, karnataka, india

chennai, tamil nadu, india

chennai, tamil nadu, india