Zettamine Labs logo

Senior Databricks Platform Engineering Lead (GCP & DevOps)

Zettamine Labs

7 - 10 years

10 - 18 Lacs

Hyderabad Pune Bengaluru

Posted:15 hours ago

Job Description

Hello All,

ZettaMine!!!

Job Title:

Location:

Experience:

Notice Period:

7-10 years

1

Databricks, GCP, Unity CataLog, CI/CD, Delta Lake, Clusters, SQL warehouses

Role Positioning

This is a Senior Lead position not an Architect position The role will provide handson offshore engineering leadership for Databricks platform implementation activities automation configuration governance rollout CICD pipeline buildout FinOps support and operational documentation

Role AttributeDetails

LocationOffshore

Role TypeSenior Lead Platform Engineering Handson Delivery

Primary FocusHandson build automation configuration documentation and earlylife platform support

Platform ScopeDatabricks on GCP Unity Catalog CICD DevOps FinOps SQL Warehouses monitoring and support readiness

Not Positioned AsDatabricks Architect Data Architect or traditional Data Engineer

Role Summary

The Senior Lead Databricks Platform Engineering Offshore will execute and lead handson platform engineering tasks for an enterprise Databricks rollout on GCP The role will work with the onshore senior lead and customer platform teams to implement Databricks foundations CICD automation Unity Catalog configuration Databricks SQL enablement monitoring FinOps reporting support and operational runbooks

Key Responsibilities

Execute platform engineering tasks aligned to the approved Databricks implementation backlog and customer platform direction

Configure Databricks workspaces workspace settings catalogs schemas storage credentials external locations and other platform components as assigned

Develop and maintain Terraform modules scripts and reusable automation assets for Databricks and related GCP platform components

Build CICD pipelines for notebooks jobs workflows SQL assets libraries and Databricks Asset Bundles using approved Git and deployment tools

Implement Unity Catalog configurations including grants access controls lineage validation auditrelated settings and governance support tasks

Configure Databricks SQL warehouses s dashboards and query performance support items for analyst and engineering teams

Implement cluster policies job policies SQL warehouse policies logging monitoring s and operational health checks

Support FinOps reporting by validating tags collecting usage metrics preparing cost views and identifying optimization opportunities

Troubleshoot workspace job cluster SQL warehouse deployment permission and connectivity issues

Create technical documentation including deployment guides configuration inventories SOPs runbooks and knowledge transfer material

Coordinate with onshore senior lead customer platform teams and internal delivery teams to close implementation tasks and support handover

Provide L2L3 implementation and earlylife platform support during rollout and stabilization

Required Skills and Experience

8 years of experience in data platform engineering cloud engineering DevOps analytics engineering or related implementation roles

Strong handson experience with Databricks implementation administration or platform engineering activities

Practical experience with Unity Catalog Delta Lake Databricks Workflows jobs clusters SQL warehouses and permissions

Strong Python SQL and scripting skills for automation troubleshooting and platform support

Handson experience with Git CICD pipelines Databricks Asset Bundles and deployment automation

Experience with Terraform or equivalent Infrastructure as Code tooling

Working knowledge of GCP foundations including IAM service accounts GCS networkingVPC concepts and monitoring

Good understanding of access management governance controls audit requirements and platform security practices

Experience creating implementation guides runbooks production support documentation and knowledge transfer materials

Ability to independently lead offshore execution while collaborating closely with onshore and customer teams

Preferred Skills

Databricks Data Engineer AssociateProfessional or equivalent practical certification

Experience with MLOps MLflow model registry model serving or Databricks platform extensions

Experience with usage reporting dashboarding cost tracking and FinOps operational support

Exposure to enterprise data governance security controls platform observability and production support models

Experience supporting postimplementation stabilization and steadystate platform operations

Expected Deliverables

Configured Databricks platform components based on approved implementation backlog

Reusable Terraformautomation modules and deployment scripts

Working CICD pipelines for Databricks assets and environment promotion

Unity Catalog configuration artifacts access control documentation and validation evidence

Databricks SQL warehouse setup documentation performance notes and operational checks

Monitoring ing FinOps support reports and platform support runbooks

Skills

Mandatory Skills :

Gangadhar.B@zettamine.com

Thanks & Regards,

Gangadhar.B

Skills Required

Devops GCP Cloud GCP Engineering Build Senior Cloud Data Bricks

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Zettamine Labs logo
Zettamine Labs

RecommendedJobs for You

Zettamine Labs logo

Hyderabad, Pune, Bengaluru

Zettamine Labs logo

Hyderabad, Pune, Bengaluru