Cloud Infrastructure, DevOps & Databricks Platform Engineer

Experience:

We are looking for an experienced Cloud Infrastructure & DevOps Engineer to design, automate, secure, and manage Azure cloud infrastructure and the Azure Databricks platform. The role involves infrastructure automation, CI/CD, platform administration, governance, monitoring, and production operations.

• Azure Infrastructure:

  Provision and manage Azure resources, VNets, subnets, NSGs, Private Endpoints, Private DNS, Azure Firewall, Key Vault, and identity/access controls.

• Infrastructure as Code:

  Develop and maintain reusable Terraform modules for automated, consistent infrastructure provisioning.

• DevOps & CI/CD:

  Build and manage Azure DevOps YAML pipelines and GitHub Actions for infrastructure and application deployments across Dev, UAT, and Prod.

• Databricks Platform Administration:

  Administer Azure Databricks workspaces, workspace access, compute resources, cluster policies, SQL warehouses, Unity Catalog, metastore configuration, service principals, and access connectors.

• Databricks DevOps:

  Automate deployment of notebooks, workflows/jobs, and related configurations across environments using CI/CD and Databricks Asset Bundles.

• Security & Governance:

  Implement RBAC, least-privilege access, private connectivity, secrets management, security policies, vulnerability remediation, and compliance controls.

• Monitoring & Operations:

  Configure Azure Monitor, Log Analytics, alerts, troubleshoot infrastructure and pipeline failures, and support production operations.

• Disaster Recovery & FinOps:

  Support backup and recovery strategies, DR planning and testing, high availability, resource optimization, and cloud cost management.

• Strong hands-on experience with Microsoft Azure infrastructure and networking.
• Proficiency in Terraform and reusable Infrastructure as Code modules.
• Experience with Azure DevOps, YAML pipelines, GitHub Actions, and Git-based workflows.
• Hands-on experience with Azure Databricks administration, Unity Catalog, access controls, compute management, and workspace governance.
• Understanding of Python, Bash, or PowerShell scripting and automation.
• Knowledge of cloud security, monitoring, troubleshooting, and production support.

• Experience with Azure Kubernetes Service (AKS) and Kubernetes.
• Experience with Databricks Asset Bundles, REST APIs, and automated workspace deployments.
• Exposure to Azure Data Factory, data platform migrations, and DataOps.
• Experience with disaster recovery, business continuity, and FinOps practices.

Strong troubleshooting and automation skills, a security-first mindset, and the ability to collaborate with data engineering, security, and application teams to deliver reliable, governed, production-ready cloud and data platforms.