D

AWS Data Lead Engineer

Dreamwings Technologies

8 years

6 - 15 Lacs

Chennai

Posted:5 days ago

Job Description

Lead Data Engineer (AWS)

Data Engineering | Chennai / Bangalore | Full-time

Experience: 8+ years in data engineering, including team leadership

Core stack: AWS (Glue, Lambda, Redshift, EMR, Kinesis), Python, PySpark, SQL, Databricks

Team scope: Leads and mentors a team of 5+ data engineers

About the Role

We're looking for a Lead Data Engineer to own the technical architecture, design, and delivery of our AWS-based data engineering solutions. You'll lead a team of engineers building scalable data pipelines and platforms, while staying hands-on with design decisions, code quality, and the toughest technical problems. This role suits someone who enjoys both the technical depth of data architecture and the people side of leading a team.

What You'll Do

Architecture & Design

  • Own technical architecture and design for data engineering solutions that power business-critical use cases
  • Design scalable, secure, and resilient solutions on AWS, applying modern data warehouse and data lake patterns
  • Evaluate and select the right technology stack — cloud-native services, open-source tools, storage, and processing frameworks

Engineering & Delivery

  • Lead, mentor, and grow a team of data engineers, ensuring quality, performance, and on-time delivery of data pipelines
  • Drive detailed technical design and data mapping specifications
  • Set and enforce coding standards and best practices, raising the bar on code quality across the team
  • Optimize solutions for performance, cost, and scalability
  • Ensure data quality and integrity for downstream systems and applications

Project & Stakeholder Management

  • Plan and prioritize data engineering work to hit delivery commitments without sacrificing quality
  • Identify risks early, troubleshoot issues, and own customer escalations
  • Partner closely with internal and customer stakeholders to keep priorities aligned

Collaboration & Documentation

  • Maintain clear technical documentation — architecture diagrams, HLD/LLD, data mapping specs, and database design
  • Work closely with BI engineers and data scientists to enable analytics, ML models, and reporting

What You Bring

  • 8+ years of hands-on experience delivering data engineering solutions
  • Experience leading a team of 5+ engineers — including stakeholder management, design/code reviews, and mentoring
  • Strong hands-on AWS experience: Glue, Lambda, Redshift, EMR, Kinesis, and related data services
  • Solid grounding in database concepts, SQL, and relational modeling, plus working knowledge of NoSQL databases
  • Strong hands-on experience building data pipelines with Python and PySpark
  • Good understanding of data lake and data warehouse concepts, modern data architecture patterns, and industry trends
  • Hands-on data modeling experience, covering both ER and dimensional modeling
  • Experience implementing data quality management solutions
  • Working knowledge of metadata management for data platforms
  • Understanding of data governance — stewardship, security, and privacy management
  • Experience with Git for source control
  • Experience with DevOps practices, including CI/CD for data engineering pipelines
  • Strong analytical and problem-solving skills
  • Excellent communication and collaboration skills

Nice to Have

  • AWS certification(s), ideally data engineering-focused
  • Experience with Amazon AppFlow, API Gateway, or DynamoDB
  • Experience with BI/visualization tools such as Power BI

Pay: ₹600,000.00 - ₹1,500,000.00 per year

Work Location: In person

Skills Required

AWS Data Engineering Team Leadership AWS Glue Python Pyspark SQL Technical Architecture Data Architecture USE Cases Data Warehouse Data Lake

Learn the skills this job asks for

Free courses, interview questions and practice for each skill.

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
D
Dreamwings Technologies

RecommendedJobs for You

D

AWS Data Lead Engineer

Dreamwings Technologies

Chennai

D

AWS Data Lead Engineer

Dreamwings Technologies

Chennai