Cloud Engineer

Job Description

Role & responsibilities: Provision and manage Azure resources such as Virtual Machines, Storage Accounts, Networking components, Databricks workspaces, and Azure SQL Managed Instance Deploy and configure Azure Databricks privately, including setting up clusters, managing workspaces, libraries, and permissions. Configured and debugged private endpoint setups and firewall rules for secure access to Azure Databricks. Optimized cluster sizing and autoscaling configurations based on workload characteristics and cost considerations. Analyzed job run logs, and cluster event logs to identify and remediate root causes of failures. Troubleshoot and resolve errors and service interruptions across the Azure ecosystem, especially issues related to Databricks, Azure Data Factory, and APIs . Monitor health and performance of services using Azure Monitor, Log Analytics, and Application Insights . Ensure optimal configuration of Azure Networking , Loadbalacer, Application Gateway,including VNets, NSGs, Firewalls, and ExpressRoute or VPNs if required. Implement and maintain RBAC, IAM policies, and resource tagging for access control and cost management. Coordinate with engineering and data teams to support infrastructure needs and resolve platform-level issues. Maintain proper backup, disaster recovery, and patch management across services. Work with Azure DevOps for resource deployment automation and release management. Designed and implemented CI/CD pipelines using GitHub Actions for automated build, test, and deployment workflows across multiple environments. Keep documentation updated for architecture, configurations, and operational processes. Designed, deployed, and managed scalable Kubernetes clusters using Azure Kubernetes Service (AKS). Configured node pools, autoscaling, and workload balancing in AKS. Implemented and maintained AKS cluster upgrades and versioning strategies. Integrated AKS with Azure services including Azure Monitor, Azure Key Vault, and Azure Container Registry (ACR). Managed network configurations including VNETs, subnets, NSGs, and private cluster setups for AKS. Designed and implemented CI/CD pipelines using GitHub Actions for automated build, test, and deployment workflows across multiple environments. Required Skills & Experience: 2-6 years of experience as an Azure Administrator or similar role. Strong hands-on experience in managing: Azure Databricks (clusters, workspaces, permissions) Azure VMs, Networking, and Storage,Backup,AKS,Keyvault,Private Endpoint Azure Monitor and Diagnostics Azure Resource Manager (ARM) templates or Bicep Proficient in identifying and resolving Azure connectivity errors and performance issues , especially in Databricks pipelines and integrations . Working knowledge of PowerShell, CLI , and portal-based operations . Familiarity with Azure Data Factory , APIM , and SQL MI is a plus. Strong troubleshooting and communication skills to work across teams.