Senior Data Engineer (Azure MS Fabric)

As a Senior Data Engineer (Azure MS Fabric) at Srijan Technologies PVT LTD, located in Gurugram, Haryana, India, you will be responsible for designing and developing scalable data pipelines using Microsoft Fabric. Your primary focus will be on developing and optimizing data pipelines, including Fabric Notebooks, Dataflows Gen2, and Lakehouse architecture for both batch and real-time ingestion and transformation. You will collaborate with data architects and engineers to implement governed Lakehouse models in Microsoft Fabric, ensuring data solutions are performant, reusable, and aligned with business needs and compliance standards. Key Responsibilities: - Designing and developing scalable data pipelines using Microsoft Fabric - Optimizing data pipelines including Fabric Notebooks, Dataflows Gen2, and Lakehouse architecture - Collaborating with data architects and engineers to implement governed Lakehouse models - Monitoring and improving the performance of data pipelines and notebooks - Applying tuning strategies to reduce costs, improve scalability, and ensure reliable data delivery - Gathering requirements and building high-quality datasets to support self-service BI initiatives - Documenting pipeline logic, lakehouse architecture, and semantic layers clearly Qualifications Required: - At least 5 years of experience in data engineering within the Azure ecosystem - Hands-on experience in Microsoft Fabric components such as Lakehouse, Dataflows Gen2, and Data Pipelines - Proficiency in building and orchestrating pipelines with Azure Data Factory and/or Microsoft Fabric Dataflows Gen2 - Strong command of SQL, PySpark, Python, and experience in optimizing pipelines for cost-effective data processing in Azure/Fabric - Experience with Lakehouses, Notebooks, Data Pipelines, and Direct Lake in Microsoft Fabric Additional Details of the Company: - Exposure to DevOps practices for Fabric and Power BI, and knowledge of Azure Databricks for Spark-based transformations and Delta Lake pipelines would be advantageous - Preferred skills include experience in the Microsoft Fabric ecosystem, familiarity with OneLake, Delta Lake, and Lakehouse principles, expert knowledge of PySpark, strong SQL, and Python scripting within Microsoft Fabric or Databricks notebooks, as well as understanding of Microsoft Purview or Unity Catalog,