4 Databricks Admin Jobs

Job Description: The Databricks Administrator/Engineer will serve as an important member of LabCorp Analytics team focused on supporting Tier 1 Business Intelligence (BI) analytic server administration. This person is part of a team of application administrators and will be responsible for the administration and support of internal-facing Databricks servers. Additionally, the selected candidate will be responsible for supporting Databricks developers/development, application integration and to end-user setup and administration. Primary Responsibilities The Databricks Administrator will be responsible for providing technical expertise in deploying applications on AWS/Azure Databricks platform. The Databricks Administrator must be self-motivated and apply knowledge of Azure to drive solutions, support the development team, and create documentation to support and describe technical solutions. Strong experience with Databricks administration, managing cloud-based big data platforms. Hands-on experience with managing permissions, AD group integration, and service principals within Databricks. Experience in setting up and managing permissions for Databricks catalogs, schemas, and jobs. Familiarity with cloud platforms (AWS, Azure, GCP) and integration with Databricks environments Install, configure, and maintain Databricks clusters and workspaces. Monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance. Implement and manage access controls and security policies to protect sensitive data. Perform regular software updates and patches. Provide technical support to Databricks users, including troubleshooting and issue resolution. Conduct training sessions to educate users on platform best practices and capabilities. Optimize cluster configurations for performance and cost-effectiveness. Monitor and manage auto-scaling to ensure resources are allocated efficiently. Implement and enforce security policies, access controls, and encryption mechanisms. Stay up-to-date with security best practices and compliance requirements. Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability. Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes. Monitor and manage platform costs, including optimizing resource utilization to control expenses. Maintain detailed documentation of configurations, procedures, and best practices. Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts, To understand their requirements and provide technical solutions. Required Skills/Experience: Bachelors Degree in computer science or an analytical discipline or equivalent experience Proven experience with Databricks server administration 7+ years overall IT experience 5+ years Databricks Administration preferably in a high availability architecture Must be able to demonstrate ability to lead system and application upgrades Proficient with troubleshooting techniques to determine root cause analysis and formulate solution recommendations Experience in Memory Management, Handle Scheduling queues & Messages, Performance Management, Supervise Clusters Health check, Regular Back up & recovery, Node Commissioning & Decommissioning, Hive connections, Kafka, Spark, Map Reduce, Tez, User Group Administration, Privilege Checks, Code Deployment to Production, Server Log Analysis and Scheduled Report Monitoring & Back up Monitoring Excellent written and verbal communication skills Works under minimal supervision with a high degree of self-motivation, commitment and integrity Willingness to learn new technologies at an accelerated pace Provides clear communication to senior management on issue identification and resolution Leverage in-depth business knowledge to translate complex business analysis and reporting requirements into technical designs Practical skills in deploying large scale environment processing millions of records per day in a high-availability environment.

Position Title: Senior Databricks Administrator Contract Duration: 1-2 Year (Contract-to-Hire based on performance) Interview Process: 2 Technical Rounds Location: Navi Mumbai (Finicity) Open to remote candidates Preference for candidates based in Navi Mumbai, Mumbai, or Pune who can commute to the office 2 -3 times per month Shift Timing: 7:00 AM 4:00 PM IST 11:00 AM 8:00 PM IST 2:00 PM 11:00 PM IST 6:00 PM – 3:30 AM IST 10:30 PM – 7:30 AM IST Job Description: 6+ years of experience managing Databricks on AWS or other cloud platforms. Strong knowledge of Databricks architecture, Unity Catalog, and cluster setup. Experience with IAM policies, SCIM integration, and access workflows. Skilled in monitoring, cost control, and governance of large Databricks setups. Hands-on with Terraform and CI/CD tools. Familiar with ETL tools and workflow orchestration (e.g., Airflow, Databricks Jobs). Responsibilities: 1. Databricks Platform Management Set up and manage Databricks workspaces for development, testing, and production. Apply rules to control how resources are used and keep costs in check. Manage Unity Catalog for organizing data and controlling access. Connect Databricks with identity providers like Okta or AWS SSO for user access. Set up CI/CD pipelines to automate code and workflow deployments. 2. Security & Compliance Set up role-based access controls (RBAC) and data permissions. Ensure the platform meets data privacy laws like GDPR and Open Banking. Manage secure access to data using tokens and secrets. Work with security teams to follow compliance rules. 3. Monitoring & Support Keep an eye on system performance, job runs, and user activity. Help fix issues like job failures or system errors (L2/L3 support). Maintain documentation, automation scripts, and alerts for system health. 4. Automation & Best Practices Use Terraform (IaC) to automate environment setup. Define naming rules and tagging standards for resources. Promote reusable templates and shared configurations. Lead training and knowledge-sharing sessions. If interested, drop your profile at nusrath.begum@priglobal.com along with the following details: Total Experience: Current CTC: Expected CTC: Notice Period:

Databricks Admin Responsibilities: Workspace Management: Create and manage Databricks workspaces, ensuring proper configuration and access control. User & Identity Management: Administer user roles, permissions, and authentication mechanisms. Cluster Administration: Configure, monitor, and optimize Databricks clusters for efficient resource utilization. Security & Compliance: Implement security best practices, including data encryption, access policies, and compliance adherence. Performance Optimization: Troubleshoot and resolve performance issues related to Databricks workloads. Integration & Automation: Work with cloud platforms (AWS, Azure, GCP) to integrate Databricks with other services. Monitoring & Logging: Set up monitoring tools and analyze logs to ensure system health. Data Governance: Manage Unity Catalog and other governance tools for structured data access. Collaboration: Work closely with data engineers, analysts, and scientists to support their workflows. Qualifications: Proficiency in Python or Scala for scripting and automation. Knowledge of cloud platforms (AWS). Familiarity with Databricks Delta Lake and MLflow. Understanding of ETL processes and data warehousing concepts. Strong problem-solving and analytical skills.

We are hiring for a Databricks Admin role to fulfill our organisation. Total Experience: 8+yrs Relevant Experience: 5+yrs Mandatory Skills: Databricks Admin, Python, Shell Scripting Location: Hyderabad(Preferred),Bangalore Role & responsibilities Workspace Management: Create and manage Databricks workspaces, ensuring proper configuration and access control. User & Identity Management: Administer user roles, permissions, and authentication mechanisms. Cluster Administration: Configure, monitor, and optimize Databricks clusters for efficient resource utilization. Security & Compliance: Implement security best practices, including data encryption, access policies, and compliance adherence. Performance Optimization: Troubleshoot and resolve performance issues related to Databricks workloads. Integration & Automation: Work with cloud platforms (AWS, Azure, GCP) to integrate Databricks with other services. Monitoring & Logging: Set up monitoring tools and analyze logs to ensure system health. Data Governance: Manage Unity Catalog and other governance tools for structured data access. Collaboration: Work closely with data engineers, analysts, and scientists to support their workflows. Qualifications: Proficiency in Python or Scala for scripting and automation. Knowledge of cloud platforms (AWS). Familiarity with Databricks Delta Lake and MLflow. Understanding of ETL processes and data warehousing concepts. Strong problem-solving and analytical skills.