Enterprise Databricks Platform Production Support

3 - 7 years

0 Lacs

Posted:2 weeks ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

You are seeking an Enterprise data platform admin to implement and maintain the Databricks platform on AWS. You should have a passion to work in an agile environment and experience in supporting the Databricks platform on AWS. Your responsibilities will include implementing and maintaining the Databricks platform, which involves workspace setup, user and group management, access control, and security configurations. You will provide technical support to data engineering, data science, and application teams, perform restores/recoveries, troubleshoot service issues, and resolve platform-related problems. Additionally, you will be responsible for installing, configuring, and maintaining Databricks clusters and workspaces. Monitoring and managing cluster performance, resource utilization, and platform costs will be part of your duties. You will also implement and manage access controls and security policies to protect sensitive data, ensuring compliance with relevant data governance and regulatory requirements. Managing and maintaining connections between Databricks and other data sources like Snowflake, optimizing data pipelines and workflows, will be crucial. Developing and maintaining automation scripts and tools for platform provisioning and routine tasks using Terraform is also part of the role. You should have at least 3+ years of experience in production support of the Databricks platform. Your technical expertise should include Terraform, AWS cloud services, Databricks administration, AWS IAM, VPC, private endpoints, firewalls, S3, and knowledge of how Databricks integrates with them. Familiarity with MLflow, Workflows, Databricks Asset Bundles, Databricks REST API, dbx CLI, Delta Live Tables (DLT), and SQL + PySpark skills for debugging and support is required. A Databricks certification would be a preferred skill for this position.,

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You