Microsoft Fabric Data Engineer

About Position:

We are seeking an experienced Microsoft Fabric Data Engineer with 5 to 8 years of hands-on experience designing, developing, and optimizing enterprise-scale data solutions on Microsoft Fabric. The ideal candidate will have strong expertise in Microsoft Fabric Data Factory, OneLake, Lakehouse, Warehouse, Delta Lake, Spark, SQL, and data engineering best practices. You will play a key role in building scalable, secure, and high-performance analytics platforms that support business intelligence, reporting, and advanced analytics initiatives.

• Role: Microsoft Fabric Data Engineer

• Location: All Persistent Locations

• Experience: 5 to 8 Years

• Job Type: Full-Time Employment

What You'll Do:

• Design, develop, and optimize scalable ETL/ELT pipelines using Microsoft Fabric Data Factory, pipelines, dataflows, and notebooks.
• Build and manage enterprise-scale data platforms using OneLake, Fabric Lakehouse, Fabric Warehouse, and Delta Lake architectures.
• Ingest, process, and transform structured, semi-structured, and unstructured data from multiple enterprise data sources.
• Develop reusable and maintainable data transformation frameworks using PySpark, Spark SQL, T-SQL, and Fabric notebooks.
• Design and implement data models and analytical data layers to support reporting, business intelligence, and advanced analytics use cases.
• Build and optimize Lakehouse architectures using Medallion Architecture principles and best practices.
• Integrate Microsoft Fabric with Azure Data Lake Storage, Azure SQL Database, APIs, and enterprise applications.
• Optimize Spark workloads, SQL queries, data pipelines, and storage strategies for performance, scalability, and cost efficiency.
• Implement pipeline orchestration, dependency management, logging, monitoring, alerting, and error-handling frameworks.
• Apply data governance, security, privacy, and compliance controls using workspace roles, permissions, lineage, sensitivity labels, and access management.
• Establish source control, CI/CD frameworks, and deployment automation using Git integration, Azure DevOps, and Fabric deployment pipelines.
• Monitor Fabric capacities, Spark workloads, pipeline execution, and SQL performance while resolving operational issues.
• Collaborate with data architects, BI developers, analysts, data scientists, and business stakeholders to deliver high-quality data products.
• Support modernization and migration initiatives from legacy or Azure-based data platforms to Microsoft Fabric.
• Contribute to platform standards, reusable frameworks, technical documentation, and operational best practices.

Expertise You'll Bring:

• 5 to 8 years of hands-on experience in Data Engineering, Data Integration, and Analytics platform development.
• Strong hands-on experience with Microsoft Fabric, including Data Factory, OneLake, Lakehouse, Warehouse, and Fabric Notebooks.
• Solid expertise in PySpark, Apache Spark, Spark SQL, T-SQL, and SQL-based data processing.
• Experience building ETL/ELT pipelines and enterprise data platforms using Microsoft Fabric services.
• Strong understanding of Delta Lake architecture, data storage optimization, and transaction management.
• Experience implementing Medallion Architecture and modern data engineering patterns.
• Strong data modeling skills for analytical, dimensional, and reporting workloads.
• Experience integrating data from APIs, cloud platforms, relational databases, and enterprise applications.
• Knowledge of Azure Data Lake Storage, Azure SQL Database, and Microsoft analytics ecosystem services.
• Experience implementing security, governance, metadata management, lineage tracking, and access control frameworks.
• Strong understanding of performance optimization techniques including partitioning, file sizing, caching, workload tuning, and query optimization.
• Hands-on experience with Git, Azure DevOps, CI/CD pipelines, and automated deployment practices.
• Experience monitoring and troubleshooting Spark jobs, pipelines, SQL workloads, and platform performance issues.
• Strong understanding of data quality, validation, reconciliation, and operational support processes.
• Excellent analytical, troubleshooting, communication, and stakeholder management skills.
• Ability to work effectively in Agile development environments and collaborate with globally distributed teams.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."