Enterprise Databricks Platform Production Support

Job Description

Looking for Enterprise data platform admin to implement and maintain the Databricks platform on AWS. Person should have passion to work in agile environment and the experience in supporting databricks platform on AWS. Responsibilities Platform Administration: Implement and maintain the Databricks platform, including workspace setup, user and group management, access control, and security configurations. Operational Support: Provide technical support to data engineering, data science, and application teams. Perform restores/recoveries, troubleshoot service issues, and resolve platform-related problems. Cluster Management: Install, configure, and maintain Databricks clusters and workspaces. Monitor and manage cluster performance, resource utilization, and platform costs. Security and Compliance: Implement and manage access controls and security policies to protect sensitive data. Ensure compliance with relevant data governance and regulatory requirements. Integration: Manage and maintain connections between Databricks and other data sources like Snowflake. Optimize data pipelines and workflows. Automation: Develop and maintain automation scripts and tools for platform provisioning and routine tasks using Terraform. Required Skills Experience: 3+ years of production support of the Databricks platform. Technical Expertise Terraform, AWS cloud services, Databricks administration AWS IAM, VPC, private endpoints, firewalls, S3 and knowledge on how Databricks integrates with them MLflow, Workflows, Databricks Asset Bundles Databricks REST API: For automation, scripting, and integration dbx CLI: For CI/CD integration Delta Live Tables (DLT): For managing streaming and batch pipelines SQL + PySpark skills to debug and support. Preferred Skills: Databricks certification Show more Show less