Data Engineering Lead

You will be responsible for leading and mentoring a team of data engineers to ensure high-quality delivery across various projects. Your role will involve designing, building, and optimizing large-scale data pipelines and integration workflows using Azure Data Factory (ADF) and Synapse Analytics. Additionally, you will be tasked with architecting and implementing scalable data solutions on Azure cloud, leveraging tools such as Databricks and Microsoft Fabric. Writing efficient and maintainable code using PySpark and SQL for data transformations will be a key part of your responsibilities. Collaboration with data architects, analysts, and business stakeholders to define data strategies and requirements is crucial. You will also be expected to implement and promote Data Mesh principles within the organization, provide architectural guidance, and offer solutions for new and existing data projects on Azure. Ensuring data quality, governance, and security best practices are followed, and staying updated with evolving Azure services and data technologies are essential aspects of the role. In terms of required skills and experience, you should possess at least 6 years of professional experience in data engineering and solution architecture. Expertise in Azure Data Factory (ADF) and Azure Synapse Analytics is necessary. Strong hands-on experience with Databricks, PySpark, and advanced SQL is also expected. A good understanding of Microsoft Fabric and its use cases, along with a deep knowledge of Azure cloud services related to data storage, processing, and integration, will be beneficial. Familiarity with Data Mesh architecture and distributed data product ownership is desirable. Strong problem-solving and debugging skills, as well as excellent communication and stakeholder management abilities, are essential for this role. It would be advantageous to have experience with CI/CD pipelines for data solutions, knowledge of data security and compliance practices on Azure, and a certification in Azure Data Engineering or Solution Architecture.,