Databricks Admin

Immediate to 45 Days

Responsibilities:

• Manage and administer Databricks workspaces, clusters, jobs, and user access
• Configure, monitor, and optimize Databricks clusters for performance and cost efficiency
• Oversee workspace governance including permissions, security policies, and data access controls
• Implement and manage Unity Catalog, cluster policies, and workspace configurations
• Monitor cluster usage, job performance, and resource utilization
• Collaborate with data engineering teams to support ETL pipelines, notebooks, and workflows
• Implement CI/CD processes for Databricks deployments using DevOps tools
• Troubleshoot platform issues, cluster failures, and job-related errors
• Manage integrations between Databricks and cloud storage platforms (AWS S3, Azure ADLS, GCP Storage)
• Ensure compliance with security, governance, and best practices across the Databricks environment
• Document administration procedures, standards, and operational guidelines

Required Skills & Experience:

• Strong hands-on experience with Databricks administration on AWS/Azure/GCP
• Proficiency in managing clusters, jobs, pools, and workspace configurations
• Good understanding of Spark, Delta Lake, and Databricks ecosystem
• Experience with Unity Catalog, access controls, and governance
• Familiarity with cloud storage (S3, ADLS, GCS) and IAM concepts
• Knowledge of CI/CD pipelines and DevOps tools (Azure DevOps, GitHub Actions, Jenkins)
• Basic scripting knowledge: Python, Shell, or PowerShell
• Strong debugging, performance tuning, and optimization skills
• Familiarity with monitoring tools and logging solutions
• Understanding of networking, VPCs, and cloud infrastructure concepts