Senior Azure Data Engineer

As a Senior Azure Data Engineer, you will be a crucial part of the team responsible for designing and implementing cutting-edge data solutions on the Azure platform within the Financial Services domain. **Key Responsibilities:** - Design, develop, and implement complex data pipelines and ETL/ELT processes using Azure Data Factory (ADF) and Azure Databricks. - Develop and maintain high-performance data solutions including data lakes, data warehouses, and data marts on Azure. - Work with large and complex datasets, implementing efficient data distribution and integration strategies. - Utilize Azure Databricks and Spark (Scala/Python) for data processing, transformation, and analysis. - Implement data quality checks and validation procedures to ensure data accuracy and integrity. - Collaborate with data analysts, scientists, and business stakeholders to translate requirements into effective data solutions. - Contribute to enhancing data governance and security practices within the organization. - Participate in all phases of the software development lifecycle and stay updated on cloud computing and big data technologies. - Mentor junior data engineers and provide guidance on best practices. **Required Skills:** - Strong coding skills in Python with experience in Pandas, NumPy, Scikit-learn. - 8+ years of hands-on experience with Azure Data Factory (ADF) and Azure Databricks. - Proficiency in Azure Storage Gen2, Azure SQL, Azure Functions, and Logic Apps. - Experience with Azure DevOps for CI/CD pipelines. - Proficiency in Spark (Scala/Python) for data processing and analysis. - Expertise in ETL/ELT processes, data warehouses, and data marts development. - Prior experience with ETL tools like Informatica, SSIS, or Talend is a plus. - Successful cloud deployments track record, preferably in Azure. - Familiarity with agile development methodologies. - Understanding of the Financial Services domain. - Excellent communication, interpersonal, and collaboration skills. Please note that the company details mentioned in the job description have been omitted.,