Technical Lead Azure Databricks

As a Technical Lead - Azure Databricks at CitiusTech, you will join an Agile team to contribute to the design and development of healthcare applications by implementing new features while ensuring adherence to the best coding development standards. Your responsibilities will include creating and configuring Databricks workspaces across various environments, setting up clusters, pools, and workspace permissions according to enterprise standards, designing and developing reusable Databricks notebooks for data ingestion, transformation, and analytics, implementing scalable Python scripts for large-scale data processing, orchestrating Databricks Workflows to automate notebook execution, DLT pipelines, and ML model deployment, as well as building and managing Delta Live Tables pipelines for real-time and batch data processing. You will also be tasked with ensuring data quality, lineage, and monitoring using DLT best practices, developing and deploying MLflow pipelines within Databricks for model tracking, versioning, and deployment, collaborating with data scientists to operationalize machine learning models using MLflow, leveraging Unity Catalog for data governance, access control, and lineage tracking, and ensuring compliance with data security and privacy standards. To excel in this role, you should have 7-8 years of experience and hold an Engineering Degree in BE / ME / BTech / MTech / BSc / MSc. Mandatory technical skills include proven experience in Databricks platform, proficiency in Python, hands-on experience with Delta Live Tables (DLT) and MLflow, familiarity with Unity Catalog, experience in Cloud platforms like Azure, AWS, or GCP, understanding of CI/CD practices and DevOps in data engineering, as well as excellent problem-solving and communication skills. CitiusTech is committed to combining IT services, consulting, products, accelerators, and frameworks with a client-first mindset and next-gen tech understanding to humanize healthcare and make a positive impact on human lives. Our culture fosters innovation and continuous learning, promoting a fun, transparent, non-hierarchical, and diverse work environment focused on work-life balance. By joining CitiusTech, you will have the opportunity to collaborate with global leaders, shape the future of healthcare, and positively impact human lives. Discover more about CitiusTech by visiting https://www.citiustech.com/careers and be part of a team that is dedicated to Faster Growth, Higher Learning, and Stronger Impact. Happy applying!,