Senior Data Engineer

About the Role

Data Engineer

Key Responsibilities

• Design, develop, and maintain scalable

  data pipelines

  using

  Azure Data Factory

  and

  Azure Synapse Analytics

  .
• Build and optimize

  lakehouse architectures

  on Azure using

  Delta Lake

  .
• Work closely with client stakeholders to understand their requirements and provide thought leadership to translate the same into technical scripts.
• Implement data ingestion, transformation, and orchestration workflows from diverse sources (APIs, databases, cloud storage).
• Ensure data quality, consistency, and security across the data lifecycle.
• Leverage Azure services such as

  Data Lake Storage Gen2

  ,

  Event Hubs

  ,

  Azure Functions

  , and

  Key Vault

  .
• Implement

  Infrastructure as Code (IaC)

  using

  Terraform

  or

  Bicep

  for automated provisioning and configuration.
• Optimize cloud resource usage for performance and cost-efficiency.
• Design and implement

  star schema

  and other data modeling techniques to support analytical workloads.
• Collaborate with analysts and data scientists to deliver advanced analytics solutions.
• Conduct data quality assessments and contribute to data governance initiatives.
• Participate in design reviews, code reviews, and cross-functional planning sessions.

Required Technical Skills

• Expert-level experience with

  Azure Data Services

  : Azure Data Factory, Azure Databricks, Azure Synapse, Azure Data Lake Storage.
• Strong proficiency in

  SQL

  for complex transformations and performance tuning.
• Advanced

  Python

  skills for data pipeline development and orchestration.
• Experience with

  Terraform

  or similar IaC tools for Azure.
• Familiarity with

  CI/CD pipelines

  and DevOps practices.
• Experience with

  containerization

  (Docker, Kubernetes) is a plus.
• Strong understanding of

  data governance

  ,

  security (RBAC, VNETs, Managed Identities)

  , and compliance in Azure.
• Experience with

  batch and streaming

  data processing using tools like

  Structured Streaming

  or

  Event Hubs

  .

Soft Skills & Mindset

• Growth mindset with a passion for continuous learning and innovation.
• Strong collaboration skills across engineering, analytics, and business teams.
• Robust client management skills
• Structured problem-solving approach with a focus on scalability and maintainability.
• Resilient under pressure with a solution-oriented attitude.
• Excellent communication and documentation skills.

Preferred Qualifications

• Microsoft Certified: Azure Data Engineer Associate or equivalent.
• Experience with

  Delta Live Tables

  ,

  Unity Catalog

  , or

  MLflow

  is a plus.
• Familiarity with

  GCP

  or

  AWS

  is a bonus.