Azure Data Engineer

Role Overview: As an experienced professional with 8-12 years of experience, you will be responsible for designing and developing scalable data solutions on the Azure Databricks platform. Your primary focus will be on data pipelines, ETL/ELT processes, collaboration with cross-functional teams, performance optimization, integration with other Azure services, maintenance, and support, as well as ensuring security and governance best practices are implemented. Key Responsibilities: - Design and develop scalable, robust data solutions on the Azure Databricks platform. - Develop and maintain data pipelines for batch and streaming data in formats like CSV, JSON, and Parquet. - Implement and optimize ETL/ELT processes to transform raw data into usable formats for analytics and reporting. - Collaborate with data engineers, data scientists, and business analysts to meet data requirements and support machine learning workflows. - Tune Databricks clusters and jobs for performance, scalability, and cost efficiency. - Integrate Databricks with other Azure services such as Azure Data Lake, Synapse, Key Vault, and SQL Database. - Monitor and troubleshoot data pipelines, resolve issues, and perform code reviews. - Implement security best practices, access controls, and data governance policies. Qualifications Required: - Strong expertise in Azure Databricks and its components. - Proficiency in programming languages like PySpark and Python. - Strong SQL skills. - Experience with other Azure services like Azure Data Factory, Azure Data Lake Storage (ADLS), and Azure SQL Database. Please share your updated CV at parul@mounttalent.com,