D

Lead Data Engineer – Azure

Dreamwings Technologies

8 years

6 - 15 Lacs

Chennai

Posted:5 days ago

Job Description

Lead Data Engineer – Azure

Data Engineering · Full-time

Experience:8+ years

Location:Chennai / Bangalore

Team Size Managed: 5+ engineers

Key Skills: Azure Data Factory, Databricks, PySpark, SQL

About the Role

We are looking for an experienced Lead Data Engineer to own the technical architecture, design, and delivery of data engineering solutions for our customers on the Microsoft Azure platform. You will lead a team of data engineers, set technical direction, and ensure our data platforms are scalable, secure, and reliable — while staying hands-on with the architecture and implementation of modern data warehouse and data lake solutions.

Key Responsibilities

Technical Architecture & Design

  • Lead technical architecture and design for data engineering solution components across business initiatives.
  • Design and implement scalable, secure, and resilient data engineering solutions on Microsoft Azure, applying sound data architecture patterns.
  • Evaluate and select the right technology stack — cloud-native services, open-source tools, data storage, and processing frameworks.

Data Engineering Development

  • Lead, mentor, and manage a team of data engineers through the development, testing, and deployment of data pipelines, ensuring quality, performance, and on-time delivery.
  • Own detailed technical design and data mapping specifications.
  • Champion best practices, coding standards, and continuous improvement in code quality and delivery excellence.
  • Optimize data solutions for performance, cost-efficiency, and scalability.
  • Ensure data quality and integrity for all downstream systems and applications.

Technical Project Management

  • Plan, prioritize, and manage data engineering projects to ensure timely, high-quality delivery.
  • Identify and mitigate risks, troubleshoot issues, and manage customer escalations.
  • Align delivery with business requirements and priorities, partnering closely with internal and customer stakeholders.

Collaboration & Documentation

  • Maintain comprehensive technical documentation — architecture diagrams, high-level/low-level integration design, data mapping specs, and database design.
  • Partner with BI engineers and data scientists to enable advanced analytics, machine learning models, and reporting solutions.

What We're Looking For

  • 8+ years of hands-on experience delivering data engineering solutions.
  • Proven experience leading a team of 5+ engineers, including stakeholder management, design and code reviews, and mentoring.
  • Strong hands-on experience with the Microsoft Azure data ecosystem: Azure Data Factory, Azure Functions, Azure Databricks, Azure Synapse Analytics, Azure Event Hub, Azure Stream Analytics, and Azure Data Lake Storage.
  • Expertise in database concepts, SQL, and relational modeling, plus good working experience with NoSQL databases.
  • Strong hands-on experience building data pipelines with Python and PySpark.
  • Solid grasp of data lake and data warehouse concepts, modern data architecture patterns, and current industry trends.
  • Hands-on data modeling experience, with a good understanding of both ER and dimensional modeling.
  • Experience implementing data quality management solutions.
  • Working knowledge of metadata management for data engineering platforms.
  • Understanding of data governance principles, including data stewardship, security, and privacy management.
  • Experience with Git for source control and with DevOps practices, including CI/CD pipelines for data engineering components.
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration skills.

Nice to Have

  • Azure certifications, preferably in Data Engineering.
  • Experience with Azure Logic Apps and API Management.
  • Familiarity with BI/visualization tools such as Power BI.

Pay: ₹600,000.00 - ₹1,500,000.00 per year

Work Location: In person

Skills Required

Azure Data Engineering Azure Data Factory Pyspark SQL Technical Architecture Microsoft Azure Data Warehouse Data Lake Data Architecture Cloud Native Open Source

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
D
Dreamwings Technologies

RecommendedJobs for You

D

Lead Data Engineer – Azure

Dreamwings Technologies

Chennai

D

Lead Data Engineer – Azure

Dreamwings Technologies

Chennai