Assistant Vice President

Job Description

Job Summary We are looking for an experienced Azure Databricks Architect who has a strong background in designing and implementing end-to-end data solutions on Azure Cloud. The ideal candidate should have expertise in Databricks, Azure Data Factory, Azure DevOps, Power BI, Unity Catalog, and data governance, cataloging, and modelling. The Azure Databricks Architect will work closely with our data engineering, data science, and business stakeholders to design and implement scalable, secure, and efficient data architectures that meet our business requirements. Key Responsibilities Design and implement scalable, secure, and efficient data architectures on Azure Cloud using Databricks, Azure Data Factory, and other related technologies. Lead the development of end-to-end data solutions on Azure Cloud, including data ingestion, processing, storage, and visualization. Collaborate with data engineering, data science, and business stakeholders to identify business requirements and design data architectures that meet those requirements. Develop and maintain data governance, cataloging, and modelling frameworks to ensure data quality, security, and compliance. Implement data security and access controls using Azure Active Directory, Unity Catalog, and other related technologies. Develop and maintain data pipelines using Azure Data Factory, Databricks, and other related technologies. Develop and maintain data visualizations using Power BI, Databricks, and other related technologies. Collaborate with DevOps engineers to develop and maintain CI/CD pipelines using Azure DevOps, Databricks, and other related technologies. Stay up-to-date with the latest Azure Cloud technologies and trends, and apply that knowledge to improve our data architectures and solutions. Requirements 5-6 years of experience in designing and implementing data architectures on Azure Cloud using Databricks, Azure Data Factory, and other related technologies. Strong experience in data governance, cataloging, and modelling, including data quality, security, and compliance. Experience in developing and maintaining data pipelines using Azure Data Factory, Databricks, and other related technologies. Experience in developing and maintaining data visualizations using Power BI or Tableau. Experience in collaborating with DevOps engineers to develop and maintain CI/CD pipelines using Azure DevOps, Databricks, and other related technologies. Strong understanding of Azure Cloud security, including Azure Active Directory, Unity Catalog, and other related technologies. Strong understanding of data architecture principles, including scalability, security, and efficiency. Bachelor's degree in Computer Science, Information Technology, or a related field. Key Technical Expertise On Python Pyspark SPARK SQL