Azure Databricks Developer

Databricks Developer

Strategic Workforce Planning System

Azure Databricks

Azure Data Lake

Power BI

PowerApps

Scope of Work

• Conceptualize and develop robust, scalable data pipelines on the Azure Databricks platform.
• Create high-performance ETL processes to ingest, transform, and store large datasets.
• Implement data validation, cleansing, and quality controls to ensure data integrity.
• Optimize pipeline performance, storage, and cost-effectiveness for efficiency.
• Monitor and troubleshoot pipeline and data flow issues to maintain smooth operations.
• Document data workflows, transformation logic, and configurations comprehensively.
• Collaborate with business and technical teams to fully understand data requirements.
• Share technical knowledge and best practices with stakeholders and team members.
  

Required Skills & Experience

• Master’s degree or equivalent experience with 5+ years in Data Science or Data Engineering roles.
• Proven experience in building data pipelines on Azure Databricks.
• Exceptional coding skills in Python and SQL for data processing.
• Proficiency in Azure Data Lake Storage (ADLS) and Azure Blob Storage.
• Hands-on experience integrating with Power BI and PowerApps.
• Familiarity with CI/CD workflows using Azure DevOps.
• Exposure to machine learning tools within Databricks.
• Experience with Azure Synapse, Azure Functions, and Databricks REST API.
• A strong grasp of data governance, data quality, and security best practices.
• Ability to thrive in cross-functional, multicultural teams.
• Strong written and verbal communication skills, with the ability to clearly convey technical concepts.
  

Preferred Qualifications

• Certifications in Databricks, Azure Data Engineering, or Cloud Architecture.
• Knowledge of Azure Active Directory, Azure Monitor, and Azure Key Vault.
• Previous experience integrating with Power Platform or serverless Azure components.
• Proven ability to excel in fast-paced, high-impact environments with a focus on innovation.