Data Engineer - Azure, Airflow, PySpark

We're hiring a Senior Data Engineer (69 years of experience) to lead the modernization of our data ecosystem from legacy platforms (Azure Synapse, SQL Server) to a next-gen Microsoft Fabric lakehouse. If you bring deep Azure expertise, strong Airflow orchestration skills, and at least 4 years of hands-on PySpark experience, this role is for you.

• Drive the migration of data pipelines and stored procedures into Microsoft Fabric using PySpark, Delta Lake, and OneLake.
• Build and orchestrate scalable workflows with Apache Airflow and Azure Data Factory (ADF).
• Redesign and optimize legacy ADF pipelines for seamless Fabric integration.
• Develop star schema (dimensional) models to improve reporting and analytics performance.
• Enforce data governance, security, version control (Git), and CI/CD best practices.
• Partner with business stakeholders, architects, and analysts to deliver high-quality, trusted data solutions.
• Support Power BI integration, semantic modeling, and performance tuning in a Fabric-first environment.

• 4+ years hands-on experience with PySpark for data engineering and transformations.
• Proven expertise in Azure Synapse, SQL Server, ADF, and Microsoft Fabric.
• Strong background in Apache Airflow, Delta Lake, OneLake, T-SQL, and KQL.
• Solid experience with dimensional modeling, governance frameworks, and Azure data security.
• Proficiency in DevOps pipelines, Git, and automated deployment practices.

• Experience modernizing ETL/ELT workloads into Fabric and lakehouse architectures.
• Microsoft Azure certification (e.g., DP-203).
• Advanced Power BI skills (DAX, MDX, DirectLake, Tabular Editor, ALM Toolkit, DAX Studio, etc.).