Data Engineer

We are seeking a Data Engineer to design, develop, and maintain data ingestion processes to a data platform built using Microsoft Technologies, ensuring data quality and integrity. The role involves collaborating with data architects and business analysts to implement solutions using tools like ADF, Azure Databricks, and requires strong SQL skills.

Key responsibilities include developing, testing, and optimizing ETL workflows and maintaining documentation. ETL development experience in Microsoft data track are required. Work with business team to translate the business requirement to technical requirements. Demonstrated expertise in Agile methodologies, including Scrum, Kanban, or SAFe.

Mandatory skill sets:

• Strong proficiency in Azure Databricks, including Spark and Delta Lake.
• Experience with Azure Data Factory, Azure Data Lake Storage, and Azure SQL Database.
• Proficiency in data integration and ETL processes and T-SQL.
• Experienced working in Python for data engineering
• Experienced working in Postgres Database
• Experienced working in graph database
• Experienced in architecture design and data modelling

Preferred Knowledge apart from above :

Good To Have Skill Sets:

• Unity Catalog / Purview
• Familiarity with Fabric/Snowflake service offerings
• Visualization tool PowerBI

Preferred skill sets:

Hands on knowledge of python, Pyspark and strong SQL knowledge. ETL and data warehousing is must.

Certifications/Credentials

(e.g., Databricks Data Engineer Associate ,Microsoft Certified: Azure Data Engineer Associate Azure Solution Architect) are mandatory (Any one)

Education qualification

Bachelor's degree in Computer Science, IT, or a related field.