Job
Description
Job Title: Team Lead – Azure Databricks Developer Location: Noida / Chennai Employment Type: [Full-time] Experience Level: 10+ years (with at least 2–3 years in a lead role) Job Summary: We are seeking a highly skilled and experienced Azure Databricks Developer to lead a data engineering team. The ideal candidate will have deep hands-on experience with Azure Data Lake Gen2 , Python programming , and Databricks for building scalable data pipelines and analytics solutions. The candidate must have prior experience in leading teams , overseeing development efforts, ensuring adherence to best practices, and collaborating with cross-functional teams. Key Responsibilities: Design, develop, and optimize scalable data pipelines and ETL processes using Azure Databricks and Python . Lead a team of data engineers in delivering high-quality data solutions and ensure alignment with project goals and timelines. Manage and maintain Azure Data Lake Gen2 storage structures, access policies, and data governance practices. Collaborate with data architects, analysts, and business stakeholders to translate data requirements into technical solutions. Implement CI/CD pipelines and version control for Databricks notebooks and Python scripts. Enforce data engineering best practices including code quality, unit testing, and documentation. Monitor performance and troubleshoot issues in Databricks jobs and Spark applications. Mentor team members and conduct code reviews to ensure code quality and knowledge sharing. Support the planning and execution of data migration, transformation, and integration projects. Required Skills & Qualifications: Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field. 5+ years of experience in data engineering or analytics, with at least 2 years of team leadership experience . Strong proficiency in Azure Databricks , Python , and Apache Spark . Solid experience with Azure Data Lake Storage Gen2 , Delta Lake, and data partitioning strategies. Familiarity with Azure ecosystem components like Azure Synapse , Azure Data Factory , and Azure Key Vault . Experience in version control (Git), CI/CD practices, and DevOps tools. Excellent problem-solving skills and ability to manage team delivery in agile environments. Strong communication and interpersonal skills for effective team and stakeholder collaboration. Preferred Qualifications: Microsoft Azure certifications (e.g., Azure Data Engineer Associate ). Experience working in regulated environments (e.g., finance, healthcare). Familiarity with data governance and security best practices in Azure. Show more Show less
