Azure Data Engineer

About The Opportunity

• Design, build and maintain end-to-end ETL/ELT pipelines using Azure Data Factory and Azure Databricks to ingest and transform structured and semi-structured data into Azure Data Lake Storage Gen2 and Synapse.
• Develop PySpark and Python data processing jobs, optimize T-SQL queries and Synapse pipelines for performance and cost-efficiency.
• Implement data modeling, partitioning, and Delta Lake patterns to ensure reliable, queryable datasets for downstream analytics and BI teams.
• Build CI/CD pipelines and infrastructure-as-code for data platform deployments using Azure DevOps and ARM/Terraform best practices.
• Monitor pipeline health, troubleshoot data quality issues, implement alerting and observability to ensure SLA compliance and low-latency delivery.
• Collaborate with data scientists, BI engineers, and business stakeholders to translate requirements into scalable, secure data solutions and operational runbooks.
  

Skills & Qualifications

Must-Have

• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Azure Data LakeStorageGen2
• PySpark
• T-SQL
• Python
• Azure DevOps
  

Preferred

• Terraform
• Delta Lake
• Power BI
  

Additional Qualifications

• Proven experience delivering production-grade Azure data platform solutions and operationalizing data pipelines in enterprise environments.
• Familiarity with data governance, security controls (RBAC, encryption) and best practices for sensitive data processing on Azure.
• Azure Data Engineer Associate certification (DP-203) or equivalent is a plus.
  

• Hands-on role on enterprise cloud projects with opportunities to work across analytics, BI and ML-enabled use cases.
• Support for upskilling and certification, collaborative engineering culture and exposure to best-practice cloud operations.
• Competitive compensation and benefits aligned with market rates for on-site India roles.