Databricks DevOps Engineer

Role: Databricks DevOps Engineer (Azure)

Location: Remote

Client: AHold

Overview:

We are seeking an experienced Databricks DevOps Engineer to join our team as a Standalone Subject Matter Expert (SME). The ideal candidate will be responsible for enabling and automating Azure Databricks infrastructure tasks, implementing secure network configurations, and supporting CI/CD pipelines. This role demands deep expertise in Databricks (80%) and general DevOps practices (20%), with strong collaboration skills to work across development, platform, and data engineering teams.

Key Responsibilities:

• Serve as a Databricks SME, managing infrastructure through the Databricks UI, CLI, and REST APIs.
• Design, implement, and maintain Azure infrastructure including Databricks workspaces, private endpoints, VNets, Subnets, NSGs, Load Balancers, and containerized environments.
• Develop and maintain Infrastructure-as-Code (IaC) solutions using Terraform for environment provisioning and configuration.
• Build and manage CI/CD pipelines using GitHub Actions to support continuous integration, testing, and deployment.
• Troubleshoot and resolve operational issues related to compute, storage, networking, and Databricks onboarding/usage.
• Enforce security best practices and ensure compliance with enterprise standards and policies.
• Collaborate with developers, data engineers, IT staff, and stakeholders to support scalable and secure deployments.
• Lead the enablement of Databricks workspaces and secure network configurations within the first 90 days.

Required Skills & Experience:

• Strong hands-on expertise with Azure Databricks, including UI, CLI, and REST APIs.
• Deep knowledge of Azure networking (VNets, Subnets, NSGs, Load Balancers) and secure infrastructure design.
• Proven experience with Terraform for IaC and automation.
• Proficiency in GitHub Actions or similar CI/CD tools (Azure DevOps, Jenkins, etc.).
• Strong troubleshooting skills for performance, deployment, and infrastructure issues.
• Excellent understanding of DevOps principles, cloud security, and best practices.
• Ability to work independently as a Standalone SME, while effectively collaborating with cross-functional teams.

Thanks & Regards:

Kanika Katiyar

Associate Recruiter

Email:kkatiyar@fcsltd.com

FCS Software Solutions Limited

https://www.fcsltd.com