Senior Azure Data Engineer - Spark/Python

You are a highly skilled and experienced Senior Azure Data Engineer with at least 8 years of experience, looking to join a dynamic team. Your main responsibility will be to design, develop, and implement cutting-edge data solutions on the Azure platform within the Financial Services domain. You will work on building robust data pipelines, data lakes, and data warehouses to support critical business decisions. Your key responsibilities will include designing and implementing complex data pipelines and ETL/ELT processes using Azure Data Factory (ADF) and Azure Databricks. You will develop and maintain high-performance data solutions, work with large and complex datasets, and leverage Azure Databricks for data processing and analysis. Additionally, you will collaborate with various stakeholders to translate their requirements into effective data solutions and contribute to data governance and security best practices. To succeed in this role, you must have strong coding skills in Python, hands-on experience with Azure Data Factory and Azure Databricks, knowledge of Azure Storage Gen2, Azure SQL, Azure Functions, and Logic Apps, proficiency in Spark (Scala/Python), and experience with ETL/ELT processes. Experience with ETL tools like Informatica, SSIS, or Talend, as well as agile development methodologies, will be beneficial. Furthermore, you should have excellent communication, interpersonal, and collaboration skills to effectively work with technical and non-technical audiences. Overall, you will play a crucial role in the development and implementation of data solutions, staying updated with the latest technologies and mentoring junior data engineers to ensure best practices are followed.,