Sr Azure Data Engineer

Job Summary:

The Senior Azure Data Engineer is responsible for designing, building, and optimizing data pipelines, data models, and analytics solutions on Microsoft Azure. This role collaborates with cross-functional teams to ensure scalable, secure, and high-performing data architectures that support business intelligence, machine learning, and data analytics initiatives.

Key Responsibilities:

• Design and develop

  data pipelines

  using

  Azure Data Factory (ADF)

  ,

  Databricks

  , and

  Synapse Analytics

  .
• Implement

  ETL/ELT processes

  to ingest and transform data from various sources (on-premises and cloud).
• Develop and maintain

  data lakes

  ,

  data warehouses

  , and

  data models

  for analytics and reporting.
• Optimize data storage and processing for performance, scalability, and cost efficiency.
  
• Implement and manage

  Azure storage solutions

  such as

  ADLS Gen2

  ,

  Blob Storage

  , and

  Azure SQL Database

  .
• Collaborate with data analysts, scientists, and business stakeholders to define data requirements and ensure data quality.
  
• Ensure

  data security

  ,

  governance

  , and

  compliance

  across Azure environments.
• Troubleshoot performance issues and optimize resource utilization across data workloads.
  
• Automate deployments and monitoring using

  CI/CD pipelines

  and

  Infrastructure as Code (IaC)

  tools (ARM, Bicep, Terraform).
• Mentor junior engineers and contribute to best practices for data engineering.
  

Required Skills and Experience:

• 6+ years

  of experience in data engineering, with

  3+ years

  on

  Azure

  platform.
• Strong experience with

  Azure Data Factory

  ,

  Databricks

  ,

  Synapse

  , and

  SQL

  .
• Proficiency in

  Python

  ,

  PySpark

  ,

  SQL

  , and

  PowerShell

  scripting.
• Deep understanding of

  data lake

  and

  data warehouse

  design principles.
• Hands-on experience with

  Azure DevOps

  ,

  Git

  , and

  CI/CD

  .
• Familiarity with

  Azure Functions

  ,

  Logic Apps

  , and

  Event Hub

  for real-time data processing.
• Knowledge of

  data governance

  ,

  security

  , and

  RBAC policies

  in Azure.
• Excellent analytical, problem-solving, and communication skills.
  

Preferred Qualifications:

• Microsoft Certified:

  Azure Data Engineer Associate (DP-203)

  or

  Azure Solutions Architect Expert

  .
• Experience with

  Power BI

  ,

  Machine Learning pipelines

  , or

  DataBricks Delta Lake

  .
• Exposure to

  Snowflake

  ,

  ADF Mapping Data Flows

  , or

  Azure Purview

  is a plus.