Associate Director - Data Engineering (Microsoft Azure Data Services )

Role & responsibilities

Data Architect We are seeking a highly skilled and experienced Data Architect to lead the design, development, and implementation of our enterprise data architecture. The ideal candidate will have deep expertise in the Microsoft Azure cloud ecosystem, with a strong focus on the emerging Microsoft Fabric platform.

You will be responsible for creating scalable, secure, and efficient data solutions that support business intelligence, advanced analytics, and data science needs across the organization.

Key Responsibilities Architecture & Design: Design end-to-end data solutions on Azure, incorporating Microsoft Fabric (OneLake, Data Warehouse), Azure Databases, and Power BI.

Data Modeling: Develop and maintain conceptual, logical, and physical data models for both relational and data warehouse environments.

Data Storage & Management: Architect and manage data storage solutions using Microsoft Fabric OneLake as the unified data lake.

Design and optimize Microsoft Fabric Data Warehouses for enterprise-scale analytics.Administer and optimize cloud databases, including Azure PostgreSQL and Azure SQL Server.ETL/ELT Development:Design, build, and maintain efficient and reliable data pipelines using Fabric Data Pipelines and Dataflows (Gen2).Develop and optimize large-scale data processing jobs using Spark Jobs (Spark SQL, PySpark, Spark Scala) within Fabric.

Reporting & Analytics: Architect the semantic layer and data models for enterprise Power BI reports and dashboards.

Establish best practices for report performance, security, and deployment. Governance & Security: Implement data governance, security, and compliance policies across the Fabric platform, including data lineage, cataloging, and access controls.

Collaboration:

Work closely with data engineers, business intelligence developers, data scientists, and business stakeholders to understand requirements and deliver robust data solutions. Innovation: Stay current with the latest developments in Azure and Microsoft Fabric, evaluating and recommending new technologies and approaches to improve our data platform

Preferred candidate profile

12+ years of experience in data architecture, data engineering, or a similar role, with at least 3+ years of hands-on experience in Azure.

Cloud Expertise: Proven experience with Microsoft Azure data services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage Gen2, Azure SQL DB).

Microsoft Fabric (Crucial): Hands-on experience with Microsoft Fabric is essential. This must include: OneLake: Understanding of the OneLake architecture and its role as a unified data lake.

Fabric Warehousing: Experience building and managing data warehouses within the Fabric environment. Fabric Pipelines & Dataflows: Proficiency in building ETL/ELT pipelines using Fabric's native tools.

Spark in Fabric: Experience developing and troubleshooting Spark Jobs. Databases: Strong proficiency in Azure PostgreSQL and/or Azure SQL Server, including performance tuning, security, and management.

Power BI: Extensive experience architecting the data backend for Power BI, including designing semantic models and optimizing for performance. Programming/Scripting: Proficiency in SQL (advanced required), PySpark/Spark SQL, and Python.

Experience with PowerShell for automation is a plus.

Data Modeling: Strong knowledge of data modeling principles (e.g., Star Schema, Kimball, Data Vault).

Problem-Solving: Excellent analytical and problem-solving skills with the ability to design solutions for complex business requirements.