Lead Data Engineer

Job Title:

Experience:

Location:

Employment Type:

About the Role

Lead Data Engineer

The ideal candidate will design high-performance data pipelines, ensure data quality and governance, and lead a team of engineers to deliver scalable and secure data solutions for analytics and AI use cases.

Key Responsibilities:

• Design & lead

  data architectures

  using

  Azure Data Factory, Databricks, Synapse, and ADLS Gen2

  .
• Develop and optimize

  ETL/ELT pipelines

  using

  PySpark

  and

  ADF

  .
• Implement

  real-time streaming

  solutions with

  Azure Event Hubs / Kafka / Stream Analytics

  .
• Apply

  Data Modeling (Star/Snowflake, Data Vault)

  and best practices for query optimization.
• Drive

  data governance, lineage, and metadata management

  using

  Azure Purview / Mcrosoft Fabric

  .
• Implement

  CI/CD pipelines

  and

  Infrastructure as Code (Terraform / Bicep / ARM templates)

  .
• Collaborate with

  data scientists, BI teams, and stakeholders

  to deliver high-quality data solutions.
• Lead & mentor a team of engineers and enforce

  best coding and architecture practices

  .

Technical Skills Required:

• Azure Data Factory (ADF)

  – Pipelines, data flows, triggers

• Azure Databricks

  – PySpark, Delta Lake, Unity Catalog

• Azure Synapse Analytics

  – SQL pools, query optimization

• Azure Data Lake (ADLS Gen2)

  – partitioning, access management

• Azure Purview / Microsoft Fabric Governance

• Azure Event Hubs / Kafka / Stream Analytics

• Programming:

  Python (Mandatory), SQL, Scala (optional)

• CI/CD & IaC:

  Azure DevOps, Terraform, Bicep

• Database Systems:

  Azure SQL DB, Cosmos DB, PostgreSQL

• Data Modeling:

  Star/Snowflake schema, Data Vault 2.0

Good to Have

• Integration experience with

  Power BI

  or

  Azure ML

• Experience in

  AI/ML data pipelines

• Familiarity with

  dbt (data build tool)

  or

  API-based ingestion

Soft Skills

• Excellent analytical and problem-solving skills
• Strong communication & stakeholder management
• Team leadership and mentoring abilities
• Agile/Scrum project delivery experience

Why Join Us

• Work on large-scale cloud data platforms
• Lead a skilled engineering team
• Exposure to cutting-edge Azure technologies
• Collaborative work culture and flexible environment

How to Apply

If you’re passionate about data engineering and ready to lead Azure data solutions at scale — apply now with your updated resume!