Senior & Lead Data Engineer - Python & Azure || Top MNC || Hyderabad

Job Title:

Experience:

Location:

Employment Type:

About the Role:

Senior Data Engineer

Key Responsibilities:

• Design and develop scalable

  data ingestion and transformation pipelines

  using

  Azure Data Factory, Azure Databricks, and Synapse Analytics

  .
• Build and manage

  ETL/ELT workflows

  integrating data from multiple sources (APIs, on-prem, SaaS, data lakes).
• Implement

  data modeling

  techniques (Star/Snowflake/Data Vault) for analytical and operational systems.
• Handle

  real-time and batch data processing

  using

  Azure Event Hubs / Kafka / Stream Analytics

  .
• Ensure

  data quality, governance, and security

  using

  Azure Purview

  ,

  Azure AD

  , and

  RBAC

  .
• Manage and optimize

  Azure Data Lake (ADLS Gen2)

  for cost and performance efficiency.
• Set up

  CI/CD pipelines

  and automate deployment using

  Azure DevOps

  ,

  GitHub Actions

  ,

  Terraform

  , or

  Bicep

  .
• Collaborate with

  data scientists, BI teams, and product stakeholders

  to deliver robust data solutions.
• Mentor junior data engineers and contribute to architectural decisions.
  

Required Technical Skills:

• Azure Data Factory (ADF)

  pipelines, triggers, linked services

• Azure Databricks

  – PySpark, Delta Lake, notebooks

• Azure Synapse Analytics

  – SQL pools, data modeling, optimization

• Azure Data Lake Storage (ADLS Gen2)

• Azure Functions / Logic Apps

  – event-driven data flows

• Azure Event Hubs / Kafka / Stream Analytics

  – streaming data processing

• Programming:

  Python (mandatory), SQL, PySpark

• DevOps Tools:

  Git, CI/CD, Azure DevOps, Terraform / Bicep / ARM templates

• Data Architecture:

  Data Warehouse, Data Lakehouse, Dimensional Modeling (Star/Snowflake)
• Knowledge of

  Power BI integration

  or

  machine learning data pipelines

  is a plus.

Soft Skills:

• Strong analytical and problem-solving mindset
  
• Excellent communication and documentation skills
  
• Team collaboration and mentoring ability
  
• Self-motivated and proactive in a fast-paced environment
  

Why Join Us?

• Opportunity to work on enterprise-level Azure data solutions
  
• Collaborative and innovative work culture
  
• Exposure to end-to-end cloud data ecosystem