Azure Databricks Developer

Job Description

We are excited to announce an opening for an experienced Databricks Developer to help us implement a cutting-edge Strategic Workforce Planning System . This role focuses on building and optimizing large-scale data pipelines with Azure Databricks , Azure Data Lake , Power BI , PowerApps , and other Microsoft Azure services. You will collaborate closely with architects, analysts, and engineering teams to deliver scalable and secure data-driven solutions. Scope of Work Conceptualize and develop robust, scalable data pipelines on the Azure Databricks platform. Create high-performance ETL processes to ingest, transform, and store large datasets. Implement data validation, cleansing, and quality controls to ensure data integrity. Optimize pipeline performance, storage, and cost-effectiveness for efficiency. Monitor and troubleshoot pipeline and data flow issues to maintain smooth operations. Document data workflows, transformation logic, and configurations comprehensively. Collaborate with business and technical teams to fully understand data requirements. Share technical knowledge and best practices with stakeholders and team members. Required Skills & Experience Master’s degree or equivalent experience with 5+ years in Data Science or Data Engineering roles. Proven experience in building data pipelines on Azure Databricks. Exceptional coding skills in Python and SQL for data processing. Proficiency in Azure Data Lake Storage (ADLS) and Azure Blob Storage. Hands-on experience integrating with Power BI and PowerApps. Familiarity with CI/CD workflows using Azure DevOps. Exposure to machine learning tools within Databricks. Experience with Azure Synapse, Azure Functions, and Databricks REST API. A strong grasp of data governance, data quality, and security best practices. Ability to thrive in cross-functional, multicultural teams. Strong written and verbal communication skills, with the ability to clearly convey technical concepts. Preferred Qualifications Certifications in Databricks, Azure Data Engineering, or Cloud Architecture. Knowledge of Azure Active Directory, Azure Monitor, and Azure Key Vault. Previous experience integrating with Power Platform or serverless Azure components. Proven ability to excel in fast-paced, high-impact environments with a focus on innovation. Skills: azure blob storage,sql,azure databricks,data science,power apps,data security,microsoft power bi,data governance,azure,integration,machine learning,azure devops,azure functions,azure data lake storage (adls),azure synapse,powerapps,azure data lake,databricks rest api,data engineering,python,databricks,data quality,ci/cd,power bi