Job
Description
As a Senior Azure Data Engineer Lead with 8-12 years of experience, you will be responsible for architecting and designing scalable, secure, and high-performing data solutions on the Microsoft Azure platform. Your role will involve collaborating with cross-functional teams to ensure alignment with business goals and technical requirements. Your deep expertise in Azure Databricks and proven leadership skills will be crucial in guiding and mentoring the team. Key Responsibilities: - Lead the design and implementation of scalable, secure, and high-performing data solutions on Azure - Build and optimize end-to-end data pipelines using Azure Databricks, Azure Data Factory, and other Azure data services - Architect and maintain cloud data infrastructure using Azure Data Lake, Azure Synapse Analytics, Azure SQL Data Warehouse, and Azure Blob Storage - Collaborate with data architects, business analysts, and developers to gather requirements and define data models - Continuously monitor and optimize data workflows and pipelines for efficient data processing - Implement best practices for data governance, security, and compliance - Provide technical leadership and mentorship to junior data engineers Qualifications Required: - Bachelors or Masters degree in Computer Science, Engineering, or a related field - 8-12 years of experience in data engineering, with 5+ years of hands-on experience with Microsoft Azure cloud technologies - Strong expertise in Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Blob Storage, Azure Data Lake, and related Azure services - Hands-on experience with PySpark, Notebooks, Structured Streaming, Unity Catalog, Delta Live Tables, Workflows, and SQL Warehouse - Proficiency in data modeling, ETL/ELT processes, data warehousing, and data pipeline architecture - Proven track record in building and optimizing large-scale data pipelines in a cloud environment - Strong skills in SQL, NoSQL databases, big data processing technologies, data transformation, integration, and quality frameworks - Expertise in data security, compliance standards, and data governance strategies - Strong leadership, communication, and collaboration skills Good to have: - Microsoft Azure Data Engineer Certification - Databricks Certified Data Engineer Professional - Familiarity with GenAI Concepts - Knowledge of DevOps Practices Please note that this job falls under the category of Digital Technologies. As a Senior Azure Data Engineer Lead with 8-12 years of experience, you will be responsible for architecting and designing scalable, secure, and high-performing data solutions on the Microsoft Azure platform. Your role will involve collaborating with cross-functional teams to ensure alignment with business goals and technical requirements. Your deep expertise in Azure Databricks and proven leadership skills will be crucial in guiding and mentoring the team. Key Responsibilities: - Lead the design and implementation of scalable, secure, and high-performing data solutions on Azure - Build and optimize end-to-end data pipelines using Azure Databricks, Azure Data Factory, and other Azure data services - Architect and maintain cloud data infrastructure using Azure Data Lake, Azure Synapse Analytics, Azure SQL Data Warehouse, and Azure Blob Storage - Collaborate with data architects, business analysts, and developers to gather requirements and define data models - Continuously monitor and optimize data workflows and pipelines for efficient data processing - Implement best practices for data governance, security, and compliance - Provide technical leadership and mentorship to junior data engineers Qualifications Required: - Bachelors or Masters degree in Computer Science, Engineering, or a related field - 8-12 years of experience in data engineering, with 5+ years of hands-on experience with Microsoft Azure cloud technologies - Strong expertise in Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Blob Storage, Azure Data Lake, and related Azure services - Hands-on experience with PySpark, Notebooks, Structured Streaming, Unity Catalog, Delta Live Tables, Workflows, and SQL Warehouse - Proficiency in data modeling, ETL/ELT processes, data warehousing, and data pipeline architecture - Proven track record in building and optimizing large-scale data pipelines in a cloud environment - Strong skills in SQL, NoSQL databases, big data processing technologies, data transformation, integration, and quality frameworks - Expertise in data security, compliance standards, and data governance strategies - Strong leadership, communication, and collaboration skills Good to have: - Microsoft Azure Data Engineer Certification - Databricks Certified Data Engineer Professional - Familiarity with GenAI Concepts - Knowledge of DevOps Practices Please note that this job falls under the category of Digital Technologies.
