Azure Platform Lead

Role & responsibilities

1. Platform Architecture & Automation

• Design and maintain core Azure infrastructure using IaC tools (Terraform, Bicep, ARM) covering VNets, subnets, Private Link, App Services, ADLS, Data Factory, Databricks and Cosmos DB.
• Build and manage

  CI/CD pipelines

  via Azure DevOps or GitHub Actions to enforce compliance, Git-based version control for notebook/workflow deployment, and automated provisioning of infrastructure.
• Automate operational tasks and governance with scripting (PowerShell, Python, Bash).

2. Git & Source Control

• Maintain

  Git version control

  for infrastructure code, Databricks notebooks, and deployment workflows across environments (dev QA production).
• Define branching strategy, enable pull request reviews, enforce code linting, secrets scanning, and merge policies.

3. Databricks Platform Administration

• Manage Databricks across account and workspace layers: clusters, jobs, Unity Catalog, access control, runtime versions, workspace settings.
• Support RBAC, SCIM sync or service principals, secure grouping/integration with Azure AD (Microsoft Entra ID), and Unity Catalog governance.
• Monitor performance, optimize cluster configurations, autoscaling, cost settings, and enforce backup & recovery practices.

4. Identity & Access Management

• Oversee Azure AD / Entra ID: create and maintain RBAC roles, PIM, group provisioning (including SCIM for Databricks), Azure AD groups, and conditional access.
• Integrate identity across platform services (Databricks, App Services, ADF), ensuring least privilege and ZeroTrust principles.

5. Networking & Security

• Architect and manage Azure networking: VNets, hubandspoke designs, NSGs, Azure Firewall/Application Gateway, Private Endpoints, ExpressRoute/VPN, traffic logging and DDoS protection.
• Implement security guardrails using Azure Policy, Microsoft Defender for Cloud, Sentinel, encryption at rest/in-transit, key vault management, and audit logging.

6. Monitoring, Cost & Governance

• Implement observability via Azure Monitor, Log Analytics, and Application Insights for platform health, pipeline jobs, and Databricks workloads.
• Manage cost governance: enforce tagging standards, manage budgets, reserved instances, rightsizing, and provide cost transparency.

7. Support, Documentation & Enablement

• Provide L2/L3 support, root cause analysis, and maintain platform availability SLAs.
• Maintain architecture diagrams, runbooks, access governance docs, and operational SOPs.
• Onboard teams: provision subscriptions/environments, network connectivity, user access, training sessions.

Preferred candidate profile

• Experience: 8+ years in IT/cloud engineering, with 5+ years on Azure and Databricks administration.
• Azure Expertise: Hands-on with Azure Networking, AD/Entra ID, Databricks, ADF/Synapse, Key Vault, App Services, Policy, and Defender.
• IaC & CI/CD: Proven proficiency in Terraform/Bicep/ARM, Git source control, Azure DevOps / GitHub Actions.
• Programming & Automation: Fluent in PowerShell, Python, and Bash.
• Security & Identity: Deep understanding of RBAC, PIM, SCIM, Defender, Sentinel, and compliance frameworks.
• Networking: Proficient in VNet topology, NSGs, firewall, routing, VPN/ExpressRoute, and hybrid connectivity.

Preferred Certifications

• Microsoft Certified: Azure Solutions Architect Expert (AZ305) Or other Azure certifications