Senior Data Engineer

Skills:

Areas of expertise:

• Develop metadata-driven pipelines in Azure Data Factory to promote reusability, scalability, and parameterization.
• Design and implement ETL solutions to extract, transform, and load data from SQL Server into Azure and Microsoft Fabric environments (Lake house/Warehouse)
• Build and manage incremental load, full load, and CDC-based pipelines using ADF or PySpark.
• Design & Implement Medallion architecture data platform
• Integrate ADF with Azure Dev Ops for version control, CI/CD automation, and release management workflows.
• Strong understanding of SQL data structures.
• Proficiency with Azure Data Factory (ADF) for data integration and orchestration.
• Experience in building scalable and efficient data warehouse and marts
• Understand star scheme & snowflake schema for DW models.
• Familiarity with Microsoft Fabric and its applications in data architecture.
• Experience with other Azure data services such as Azure Synapse Analytics, Azure SQL Database, and Azure Data Lake Storage.
• Experience with big data technologies like Hadoop, Spark, and Databricks
• Excellent problem-solving skills and attention to detail.
• Strong communication and interpersonal skills.
• Ability to work collaboratively in a fast-paced, team-oriented environment.