Cloud Engineer

Role & responsibilities:

• Provision and manage

  Azure resources

  such as Virtual Machines, Storage Accounts, Networking components, Databricks workspaces, and Azure SQL Managed Instance
• Deploy and configure

  Azure Databricks

  privately, including setting up clusters, managing workspaces, libraries, and permissions.
• Configured and debugged private endpoint setups and firewall rules for secure access to Azure Databricks.
• Optimized cluster sizing and autoscaling configurations based on workload characteristics and

  cost considerations.

• Analyzed job run logs, and cluster event logs to identify and remediate root causes of failures.
• Troubleshoot and

  resolve errors and service interruptions

  across the Azure ecosystem, especially issues related to

  Databricks, Azure Data Factory, and APIs

  .
• Monitor health and performance of services using

  Azure Monitor, Log Analytics, and Application Insights

  .
• Ensure optimal configuration of

  Azure Networking

  , Loadbalacer, Application Gateway,including VNets, NSGs, Firewalls, and ExpressRoute or VPNs if required.
• Implement and maintain

  RBAC, IAM policies, and resource tagging

  for access control and cost management.
• Coordinate with engineering and data teams to support infrastructure needs and resolve platform-level issues.
• Maintain proper

  backup, disaster recovery, and patch management

  across services.
• Work with Azure DevOps for resource deployment automation and release management.
• Designed and implemented CI/CD pipelines using GitHub Actions for automated build, test, and deployment workflows across multiple environments.
• Keep documentation updated for architecture, configurations, and operational processes.
• Designed, deployed, and managed scalable Kubernetes clusters using Azure Kubernetes Service (AKS).
• Configured node pools, autoscaling, and workload balancing in AKS.
• Implemented and maintained AKS cluster upgrades and versioning strategies.
• Integrated AKS with Azure services including Azure Monitor, Azure Key Vault, and Azure Container Registry (ACR).
• Managed network configurations including VNETs, subnets, NSGs, and private cluster setups for AKS.
• Designed and implemented CI/CD pipelines using GitHub Actions for automated build, test, and deployment workflows across multiple environments.

Required Skills & Experience:

• 2-6 years of experience as an Azure Administrator or similar role.
• Strong hands-on experience in managing:

• Azure Databricks

  (clusters, workspaces, permissions)

• Azure VMs, Networking, and Storage,Backup,AKS,Keyvault,Private Endpoint

• Azure Monitor and Diagnostics

• Azure Resource Manager (ARM) templates or Bicep

• Proficient in identifying and resolving

  Azure connectivity errors and performance issues

  , especially in

  Databricks pipelines and integrations

  .
• Working knowledge of

  PowerShell, CLI

  , and

  portal-based operations

  .
• Familiarity with

  Azure Data Factory

  ,

  APIM

  , and

  SQL MI

  is a plus.
• Strong troubleshooting and communication skills to work across teams.