Ekloud - Data Engineer - Microsoft Fabric

Key Responsibilities

• Design, develop, and maintain data pipelines and dataflows (Gen2) using Microsoft Fabric.
• Develop and manage Fabric notebooks leveraging Python and Spark SQL for data processing and analytics.
• Implement CI/CD pipelines within the Fabric environment to ensure seamless deployment and version control.
• Design and enforce data security and governance standards across Fabric environments.
• Build and optimize Direct Lake models and perform DAX scripting for advanced analytics.
• Integrate and manage data ingestion, transformation, and orchestration workflows across hybrid cloud environments (Fabric + GCP).
• Leverage BigQuery, Pub/Sub, and Cloud Functions for real-time data streaming and processing.
• Collaborate with cross-functional teams to ensure data consistency, quality, and compliance with enterprise standards.
• Continuously evaluate emerging tools and technologies to enhance data engineering capabilities.
  

Required Skills & Experience

Microsoft Fabric Expertise :

• Pipelines & Dataflow Gen2
• Fabric Notebooks (Python, Spark SQL)
• CI/CD Implementation
• Security & Access Controls
• Direct Lake Models
• DAX for analytics and modeling
  

Google Cloud Platform (GCP) Expertise

• BigQuery
• Cloud Functions
• Pub/Sub
  

Additional Skills

• Strong understanding of data modeling, ETL/ELT processes, and data warehousing concepts.
• Hands-on experience with version control systems (Git) and DevOps practices.
• Excellent problem-solving and debugging skills in distributed environments.
• Ability to work independently in a remote, fast-paced environment aligned with UK business hours.
  

Preferred Qualifications

• Certification in Microsoft Fabric, Azure Data Engineering, or GCP Data Engineering.
• Experience in multi-cloud data integration and governance frameworks.
• Familiarity with Power BI or similar analytics platforms.