Location:
Mumbai
Experience:
3–5 Years
Employment Type:
Full-time
Company Description
NDS Infotech Ltd is a Microsoft Solution Partner specializing in consulting, implementation, and support services for digital transformation with Automation, Low Code, Analytics & AI. NDS offers solutions in Intelligent Applications, Agentic AI solutions, Custom AI Assistants, Data & Analytics, Robotic/Business Process Automation, Low Code Solutions, and Demand, Project & Portfolio Management across various industries.
Job Overview
We are looking for a Data Lake Engineer with 3–5 years of experience in Microsoft Fabric and data engineering. The ideal candidate should have hands-on experience in building and managing data pipelines, developing data lakehouse solutions, and working with large datasets using Microsoft Fabric and related Microsoft technologies.
Key Responsibilities
-
Design, develop and maintain data pipelines using Microsoft Fabric.
-
Work with Fabric Lakehouse, Data Warehouse and OneLake.
-
Develop ETL/ELT processes for data ingestion, transformation and integration.
-
Build and optimise data workflows using Fabric Data Factory.
-
Work with PySpark, SQL and notebooks for data processing and transformation.
-
Implement data quality checks and ensure data accuracy and consistency.
-
Monitor and troubleshoot data pipelines and resolve performance issues.
-
Collaborate with data analysts, architects and other engineering teams.
-
Follow data security, governance and data management best practices.
Required Skills & Experience
-
3–5 years of hands-on experience in Data Engineering.
-
Strong working knowledge of Microsoft Fabric.
-
Experience with Fabric Lakehouse, OneLake and Data Warehouse.
-
Proficiency in SQL and Python/PySpark.
-
Experience in developing ETL/ELT pipelines.
-
Understanding of data modelling and data warehousing concepts.
-
Experience with data integration and transformation.
-
Knowledge of Delta Lake and Parquet file formats.
-
Understanding of data pipeline optimisation and troubleshooting.
Good to Have
-
Experience with Azure Data Factory and Azure Data Lake Storage (ADLS Gen2).
-
Knowledge of Power BI and data analytics.
-
Experience with Azure Databricks.
-
Familiarity with Git, CI/CD and deployment practices.
-
Understanding of Microsoft Azure cloud services.
Preferred Candidate
-
Strong analytical and problem-solving skills.
-
Ability to work independently and collaboratively.
-
Good communication and coordination skills.
Skills: microsoft azure,data warehouse,ci/cd,delta lake,sql,power bi,pyspark,etl/elt,notebooks,parquet,azure data factory,azure databricks,git,azure data lake storage,microsoft fabric,onelake,fabric lakehouse