Azure Data Engineer

As an experienced Azure Data Engineer with over 8 years of experience, you will play a key role in designing and implementing scalable data pipelines and ETL processes within the Azure ecosystem. Your expertise in data warehousing, data pipelines, and cloud-based data processing frameworks will be crucial for this role. Key Responsibilities: - Design and implement scalable data pipelines and ETL processes using Azure Data Factory (ADF), PySpark, and Databricks. - Manage and optimize Azure Data Lake and integrate with Azure Synapse Analytics for large-scale data storage and analytics. - Collaborate with cross-functional teams to gather requirements, design data solutions, and deliver actionable insights. - Develop and optimize SQL queries for data extraction and transformation. - Apply data modeling techniques and implement best practices for data governance and quality. - Work closely with BI developers and stakeholders to support reporting and dashboarding solutions. - Implement and manage CI/CD pipelines for data engineering solutions. Required Skills: - 8+ years of experience in Azure Data Engineering. - Strong proficiency in SQL and at least one programming language (preferably Python). - Deep experience with Azure Data Factory (ADF), Azure Databricks, Azure Data Lake, Azure Synapse Analytics, and PySpark. - Knowledge of data warehousing concepts and implementation. - Experience in Apache Spark or similar ETL tools. - Experience with Microsoft Fabric (MS Fabric). - Familiarity with Power BI for data visualization. - Domain knowledge in Finance, Procurement, or Human Capital. Please note that the company's additional details were not provided in the job description.,