Azure Data Enginee

About The Opportunity

• Design, build and operationalize end-to-end data pipelines and ETL/ELT workflows on Azure using Azure Data Factory, Databricks, and Synapse Analytics.
• Ingest, process and transform structured and semi-structured data into ADLS/Blob Storage and curate analytics-ready datasets with strong data modelling practices.
• Develop scalable Spark/PySpark jobs and Python-based services to support batch and near-real-time processing; optimize performance and cost for large-scale workloads.
• Implement CI/CD, automated deployment (ARM/Terraform), unit testing and observability for data pipelines using Azure DevOps/Git and monitoring tools.
• Enforce data security, access controls and governance (role-based access, encryption, lineage) and collaborate with compliance teams to meet enterprise requirements.
• Partner with Data Scientists, BI developers and business stakeholders to translate data requirements into reliable, production-grade data products and dashboards.
  

Skills & Qualifications

Must-Have

• 3+ years hands-on experience building Azure data solutions (ADF, Databricks, Synapse) in production environments.
• Strong SQL and Python skills; proven experience authoring PySpark/Spark jobs and optimizing query performance.
• Experience with ADLS/Blob Storage, delta/parquet formats, and data modelling for analytics.
• Familiarity with CI/CD pipelines (Azure DevOps/Git), automated deployments (ARM/Terraform) and unit/integration testing for data pipelines.
• Understanding of data security, encryption, RBAC and compliance requirements for enterprise data platforms.
  

Preferred

• Azure Data Engineer Associate or other relevant Azure certifications.
• Experience with Power BI or other BI tools and delivering end-to-end reporting solutions.
• Exposure to event-driven ingestion (Kafka, Event Hubs), real-time processing and cost-optimisation strategies.
  

• Competitive compensation and clear career progression on enterprise cloud-data tracks.
• Hands-on exposure to large-scale Azure projects, mentoring, and certification support.
• Collaborative, performance-driven engineering culture focused on quality, automation and measurable business impact.