Azure Data Engineer

Job Description

Job Description: We are looking for an experienced Azure Data Engineer to join our team. The ideal candidate will have expertise in designing, implementing, and managing data solutions using Azure services. You will work with a team to build and optimize data pipelines, manage Azure storage solutions, and integrate various Azure services to deliver high-performance data solutions. Key Responsibilities: Implement and manage Managed Identities in Azure for secure authentication and access control. Work with Azure Data Lake and Azure Storage Accounts to efficiently store and manage large datasets. Develop and optimize ETL/ELT pipelines using Azure Data Factory (ADF) and Mapping DataFlows . Write efficient SQL queries for database management and data processing. Develop data processing solutions using Python, Spark, Scala, or C# . Integrate and utilize Azure Synapse Analytics, Azure Data Lake Storage (ADLS), and Azure Data Warehouse (DWH) for scalable analytics solutions. Leverage Azure Cognitive Services and Azure AI for advanced data processing and analytics (Good to have). Automate workflows using Azure Logic Apps and Azure Functions . Develop interactive reports and dashboards using Power BI . Follow DevOps best practices , including GIT repositories, build/release pipelines , and CI/CD for data solutions. Requirements: Proven experience working with Azure Data Services such as ADF, ADLS, Synapse, Azure Storage, and Cognitive Services . Strong experience with SQL programming and database management. Hands-on experience in ETL/ELT processes using Azure Data Factory and Mapping DataFlows. Proficiency in at least one programming language: Python, Spark, Scala, or C# . Familiarity with Azure Logic Apps, Azure Functions, and Power BI (Good to have). Knowledge of DevOps practices , including GIT, CI/CD pipelines, and build/release automation . Excellent problem-solving skills and the ability to work collaboratively in a team environment. Nice to Have: Experience with Azure Cognitive Services and Azure AI for data processing. Knowledge of Azure Synapse Analytics and Azure Data Warehouse .