Senior Data Engineer

About the Role:

We are looking for an experienced Data Engineer who will be responsible for designing, building,

and maintaining scalable data pipelines and solutions on Microsoft Fabric platforms. The ideal

candidate will have solid programming skills, strong knowledge of data processing frameworks,

and hands-on capability in optimizing data workflows.

Key Responsibilities:

• Design and implement end-to-end Microsoft Fabric solutions, including data

integration, transformation, and analytics.

• Proficiency in Microsoft Fabrics Notebook for developing Apache Spark jobs.
• Hands-on experience with Python, PySpark and SparkSQL/TSQL for data

transformations.

• Experience working with 

  File Transfer Services - FTS

  (GoAnywhere preferred - automatedand secure data movement across environments)
• Advanced SQL skills and proficiency in data integration techniques, ETL/ELT processes,

and data pipeline architectures.

• Extensive knowledge of MS Fabric components like: Lakehouses, OneLake, Data

Pipelines, Real-Time Analytics, Power BI Integration, Semantic Model.

• Familiarity with Azure services such as Azure Synapse, Azure Data Lake, and Azure SQL.

Mandatory Skills:

• Expertise in Microsoft Azure/Fabric data services.
• Strong proficiency in Python and SQL.
• Hands-on experience with PySpark for distributed data processing.
• Solid understanding of ETL/ELT development and data pipeline orchestration.

Good-to-Have Skills:

• Familiarity with DevOps practices (CI/CD for data pipelines, containerization,

infrastructure as code)

• Knowledge of data governance and best practices for enterprise data systems.