Azure Data Engineer

Azure Data Engineer / Technical Lead

Location : Pan India, On site

Department : CBG Data & Analytics

Who you are :

Azure Data Engineer

Key Responsibilities

• Architect & Design:

  Lead the architectural design of our modern data platform using Azure services. Define the strategy for our enterprise data lakehouse/warehouse utilizing

  Azure Synapse Analytics

  ,

  Azure Databricks

  , and

  Azure Data Lake Storage (ADLS Gen2)

  .

• Technical Ownership:

  Take end-to-end ownership for the design and development of complex data ingestion, transformation, and orchestration pipelines using

  Azure Data Factory (ADF)

  and

  Azure Databricks

  .

• Establish Best Practices:

  Develop, document, and enforce best practices for data engineering, including standards for T-SQL, PySpark, data modeling, and infrastructure deployment. Champion code quality through rigorous code reviews and knowledge sharing.

• Performance & Optimization:

  Continuously monitor, troubleshoot, and optimize Azure data services for performance and cost. Implement best practices for partitioning, indexing, cluster management, and Synapse SQL pool distribution.

• DevOps & Automation (DataOps):

  Drive the automation of our data platform by building and maintaining CI/CD pipelines using

  Azure DevOps (Pipelines & Repos)

  . Implement Infrastructure as Code (IaC) using

  ARM templates

  or

  Bicep

  to ensure consistent and repeatable environments.

• Collaboration & Mentorship:

  Serve as the technical SME for the Azure data stack, collaborating with business analysts, data scientists, and application teams. Mentor junior engineers and elevate the technical capabilities of the entire team.

Required Skills & Qualifications

• Experience:

  5+ years of experience with 3+ years hands-on experience in data engineering and building solutions on the

  Microsoft Azure

  platform.

• Azure Expertise:

  Deep, practical knowledge of the core Azure data services:

• Azure Data Factory (ADF)

  for orchestration.

• Azure Databricks

  or

  Azure Synapse Analytics

  for data processing and warehousing.

• Azure Data Lake Storage (ADLS Gen2)

  for storage.
• Familiarity with other services like Azure Functions, Azure SQL DB, and Microsoft Purview.

• Expert Programming & SQL Skills:

  Mastery of

  T-SQL

  and strong programming skills in

  Python

  and

  PySpark

  for large-scale data transformation.

• Data Modeling:

  Proven experience designing and implementing data models (e.g., Kimball, Inmon, Data Vault) optimized for analytical workloads.

• Azure DevOps:

  Strong, hands-on experience using

  Azure DevOps

  for source control (Git), build/release pipelines (CI/CD), and work item tracking.

• Infrastructure as Code (IaC):

  Demonstrable experience deploying and managing Azure resources using

  ARM templates

  or

  Bicep

  .

Nice to Have

• Certification:

  Microsoft Certified:

  Azure Data Engineer Associate (DP-203)

  or related Azure certifications are highly preferred.

• Streaming Data:

  Experience with real-time data processing using Azure Stream Analytics, Event Hubs, or IoT Hub.

• BI & Visualization:

  Experience connecting

  Power BI

  to Azure data sources and optimizing datasets for performance.

• Security:

  Solid understanding of Azure security principles, including Managed Identities, Azure Key Vault, and Private Endpoints.

• Leadership:

  Previous experience in a technical leadership or mentorship role

Interested candidates can drop your resumes at talent@sunware.in