Lead Data Engineer

Role: Lead Data Engineer

Location: Hyderabad/Chennai, Remote

Experience:8+Years

Overview

highly skilled Lead Data Engineer

hands-on problem solver

Key Responsibilities

• Design, develop, and optimize

  data pipelines

  using

  Azure and Databricks

  .
• Hands-on work with

  Databricks Asset Bundles (DABs)

  for CI/CD and environment management.
• Build and manage scalable

  ELT/ETL workflows

  with Databricks, Delta Lake, ADF, and other Azure services.
• Continuously adopt and apply

  new Databricks features

  to accelerate delivery.
• Optimize Spark, SQL, and Python code for

  performance and scalability

  .
• Apply

  software engineering best practices

  (e.g., TDD, CI/CD, modular design, code reviews) to ensure a

  robust, maintainable, and strategic data ecosystem

  .
• Mentor team members to

  improve overall team productivity and technical capability

  .
• Deliver in a

  fast-paced environment with quick turnaround expectations

  .

Required Skills & Experience

• 8+ years

  in Data Engineering with at least

  5 years hands-on in Azure & Databricks

  .
• Strong expertise in:

• Databricks

  (Delta Lake, Databricks SQL, Workflows,

  Databricks Asset Bundles

  , MLflow basics, unity catalog)

• Azure Data Services

  (ADF, Azure Synapse (good to have), Azure Data Lake, Azure SQL)

• Python, SQL, Spark

  (with proven performance optimization skills)
• Strong knowledge of

  modern data architectures

  (Lakehouse, governance).
• Track record of

  efficient delivery

  and helping teams accelerate execution.