Azure DevOps Engineer – Azure Databricks & Terraform
Experience: 5+ Years
Location: Mumbai Andheri
Employment Type: Full-time
Job Summary
We are looking for an experienced Azure DevOps Engineer to design, build, and maintain secure, scalable, and automated cloud infrastructure and data platform solutions using Microsoft Azure, Terraform, GitLab CI/CD, and Azure Databricks.
The ideal candidate will have strong expertise in Infrastructure as Code (IaC), CI/CD automation, Azure cloud services, and platform engineering, along with experience supporting enterprise-scale data platforms.
Key Responsibilities
- Design, implement, and maintain Infrastructure as Code (IaC) solutions using Terraform.
- Develop, manage, and optimize GitLab CI/CD pipelines for infrastructure provisioning and application deployments.
- Automate the provisioning and lifecycle management of Azure Databricks workspaces, Unity Catalog, Azure Storage Accounts, Key Vaults, Managed Identities, and networking components.
- Build and maintain deployment frameworks for Databricks Asset Bundles, Workflows, notebooks, libraries, and cluster policies.
- Develop reusable Terraform modules, CI/CD templates, and automation tools to standardize cloud platform deployments.
- Implement and maintain security, access controls, governance, and compliance standards across Azure and Databricks environments.
- Collaborate with Data Engineers, Solution Architects, Security Teams, Platform Teams, and DevOps Engineers to deliver reliable platform solutions.
- Monitor platform performance, availability, resource utilization, and cloud expenditure, identifying opportunities for optimization.
- Troubleshoot infrastructure, deployment, networking, authentication, and configuration issues.
- Apply cloud cost management and FinOps practices to improve resource efficiency.
- Support enterprise data platforms and data engineering workloads in cloud environments.
Required Skills and Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline, or equivalent practical experience.
- 5+ years of experience in DevOps, Cloud Engineering, Platform Engineering, or a similar role.
- 5+ years of hands-on experience designing and managing enterprise-scale solutions on Microsoft Azure.
- Strong expertise in Terraform and Infrastructure as Code for cloud resource provisioning and management.
- Proficiency in GitLab, Git-based development workflows, and CI/CD pipeline implementation.
- Good knowledge of Azure services, including Storage Accounts, Key Vault, Azure Monitor, Managed Identities, and Microsoft Entra ID.
- Experience with Azure networking, including Virtual Networks (VNet), Private Endpoints, Private DNS Zones, and network security controls.
- Proficiency in scripting and automation using Python, Bash, or PowerShell.
- Understanding of cloud-based data platform architecture and data engineering workflows.
- Familiarity with FinOps principles and Azure cloud cost optimization.
- Strong problem-solving, communication, and collaboration skills.
- Experience working in Agile delivery environments.
Preferred Qualifications
- Hands-on experience with Azure Databricks administration and platform engineering.
- Experience with Unity Catalog, Databricks Asset Bundles, Databricks Workflows, and automated deployments.
- Experience deploying and supporting enterprise-scale data platforms and data engineering workloads.
- Knowledge of security, governance, identity management, and access control across Azure and Databricks.
- Experience with observability and monitoring tools such as Dynatrace, Grafana, Elasticsearch, Fluent Bit, or OpenTelemetry.
- Exposure to Azure application platforms, particularly Azure Kubernetes Service (AKS).
Ideal Candidate Profile
The ideal candidate is a hands-on cloud and DevOps professional with strong Terraform and Azure expertise, capable of building automated deployment pipelines and managing secure, enterprise-grade cloud infrastructure. Experience with Azure Databricks and data platform automation will be a significant advantage.
Interested candidates can apply with their updated resume, highlighting relevant experience in Azure, Terraform, GitLab CI/CD, and Azure Databricks.
Pay: ₹2,000,000.00 - ₹4,500,000.00 per year
Benefits:
Work Location: In person
