Posted:8 hours ago|
Platform:
On-site
Full Time
We are seeking an experienced Databricks Administrator with 7+ years of expertise in managing and optimizing Databricks environments. The ideal candidate should have hands-on experience with Azure/AWS Databricks, cluster management, security configurations, and performance optimization. This role requires close collaboration with data engineering and analytics teams to ensure smooth operations and scalability. About the Role The Databricks Administrator will be responsible for managing and optimizing Databricks environments, ensuring performance, security, and scalability. Responsibilities Deploy, configure, and manage Databricks workspaces, clusters, and jobs. Monitor and optimize Databricks performance, auto-scaling, and cost management. Implement security best practices, including role-based access control (RBAC) and encryption. Manage Databricks integration with cloud storage (Azure Data Lake, S3, etc.) and other data services. Automate infrastructure provisioning and management using Terraform, ARM templates, or CloudFormation. Troubleshoot Databricks runtime issues, job failures, and performance bottlenecks. Support CI/CD pipelines for Databricks workloads and notebooks. Collaborate with data engineering teams to enhance ETL pipelines and data processing workflows. Ensure compliance with data governance policies and regulatory requirements. Maintain and upgrade Databricks versions and libraries as needed. Qualifications 7+ years of experience as a Databricks Administrator or in a similar role. Strong knowledge of Azure/AWS Databricks and cloud computing platforms. Hands-on experience with Databricks clusters, notebooks, libraries, and job scheduling. Expertise in Spark optimization, data caching, and performance tuning. Proficiency in Python, Scala, or SQL for data processing. Experience with Terraform, ARM templates, or CloudFormation for infrastructure automation. Familiarity with Git, DevOps, and CI/CD pipelines. Strong problem-solving skills and ability to troubleshoot Databricks-related issues. Excellent communication and stakeholder management skills. Preferred Skills Databricks certifications (e.g., Databricks Certified Associate/Professional). Experience in Delta Lake, Unity Catalog, and MLflow. Knowledge of Kubernetes, Docker, and containerized workloads. Experience with big data ecosystems (Hadoop, Apache Airflow, Kafka, etc.). Shift Timing: 10PM to 6AM IST (Fixed)
Numeric Technologies
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Python coding challenges to boost your skills
Start Practicing Python NowSalary: Not disclosed
Mumbai, Maharashtra, India
Salary: Not disclosed
Bangalore Urban, Karnataka, India
Salary: Not disclosed
Pune, Maharashtra, India
1.0 - 2.0 Lacs P.A.
Pune, Maharashtra, India
2.0 - 3.0 Lacs P.A.
Pune, Maharashtra, India
3.5 - 11.5 Lacs P.A.
Sonipat, Haryana, India
Salary: Not disclosed
Hyderabad
8.0 - 18.0 Lacs P.A.
Pune
12.0 - 13.0 Lacs P.A.
Bangalore Urban, Karnataka, India
Salary: Not disclosed
