Data Engineer – MS Fabric

Job Title: Data Engineer – MS Fabric

Location: Chennai - Excelencia Office

Experience: 4+ Years

Employment Type: Full-Time

Work Mode: Work From Office

Mandatory Skills:

• Microsoft Fabric
  
• Azure Data Factory (ADF)
  
• Azure Synapse Analytics
  
• Delta Lake, OneLake, Lakehouses
  
• Python, PySpark, Spark SQL, T-SQL
  
• Data Pipelines & Real-Time Analytics
  
• ETL/ELT Development

Job Responsibilities:

• Design, build, and optimize data pipelines using Microsoft Fabric, Azure Data Factory, and Synapse Analytics.
  
• Develop and maintain Lakehouses, Notebooks, and data flows within the Microsoft Fabric ecosystem.
  
• Ensure efficient data integration, quality, and governance across OneLake and other Fabric components.
  
• Implement and maintain real-time analytics pipelines for high-throughput data processing.
  
• Work with Delta Lake, Parquet, and various data formats (e.g., JSON, XML, CSV) for storage and transformation.
  
• Perform complex data transformations using Python, PySpark, Spark SQL, and T-SQL.
  
• Collaborate with cross-functional teams to define and deliver end-to-end data engineering solutions.
  
• Participate in Agile ceremonies and use tools like JIRA for project tracking and delivery.
  
• Use monitoring tools and job scheduling frameworks to ensure reliability and performance of data systems.

Preferred Skills:

• Strong understanding of distributed computing and cloud-native data architecture
  
• Experience with DataOps practices and data quality frameworks
  
• Familiarity with CI/CD for data pipelines
  
• Experience in handling large-scale data warehousing and analytics workloads

Soft Skills:

• Strong problem-solving and analytical thinking
  
• Excellent communication and collaboration skills
  
• Self-motivated and proactive with a continuous learning mindset