7 - 10 years
10 - 18 Lacs
Posted:15 hours ago
Hello All,
7-10 years
1
Role Positioning
This is a Senior Lead position not an Architect position The role will provide handson offshore engineering leadership for Databricks platform implementation activities automation configuration governance rollout CICD pipeline buildout FinOps support and operational documentation
Role AttributeDetails
LocationOffshore
Role TypeSenior Lead Platform Engineering Handson Delivery
Primary FocusHandson build automation configuration documentation and earlylife platform support
Platform ScopeDatabricks on GCP Unity Catalog CICD DevOps FinOps SQL Warehouses monitoring and support readiness
Not Positioned AsDatabricks Architect Data Architect or traditional Data Engineer
Role Summary
The Senior Lead Databricks Platform Engineering Offshore will execute and lead handson platform engineering tasks for an enterprise Databricks rollout on GCP The role will work with the onshore senior lead and customer platform teams to implement Databricks foundations CICD automation Unity Catalog configuration Databricks SQL enablement monitoring FinOps reporting support and operational runbooks
Key Responsibilities
Execute platform engineering tasks aligned to the approved Databricks implementation backlog and customer platform direction
Configure Databricks workspaces workspace settings catalogs schemas storage credentials external locations and other platform components as assigned
Develop and maintain Terraform modules scripts and reusable automation assets for Databricks and related GCP platform components
Build CICD pipelines for notebooks jobs workflows SQL assets libraries and Databricks Asset Bundles using approved Git and deployment tools
Implement Unity Catalog configurations including grants access controls lineage validation auditrelated settings and governance support tasks
Configure Databricks SQL warehouses s dashboards and query performance support items for analyst and engineering teams
Implement cluster policies job policies SQL warehouse policies logging monitoring s and operational health checks
Support FinOps reporting by validating tags collecting usage metrics preparing cost views and identifying optimization opportunities
Troubleshoot workspace job cluster SQL warehouse deployment permission and connectivity issues
Create technical documentation including deployment guides configuration inventories SOPs runbooks and knowledge transfer material
Coordinate with onshore senior lead customer platform teams and internal delivery teams to close implementation tasks and support handover
Provide L2L3 implementation and earlylife platform support during rollout and stabilization
Required Skills and Experience
8 years of experience in data platform engineering cloud engineering DevOps analytics engineering or related implementation roles
Strong handson experience with Databricks implementation administration or platform engineering activities
Practical experience with Unity Catalog Delta Lake Databricks Workflows jobs clusters SQL warehouses and permissions
Strong Python SQL and scripting skills for automation troubleshooting and platform support
Handson experience with Git CICD pipelines Databricks Asset Bundles and deployment automation
Experience with Terraform or equivalent Infrastructure as Code tooling
Working knowledge of GCP foundations including IAM service accounts GCS networkingVPC concepts and monitoring
Good understanding of access management governance controls audit requirements and platform security practices
Experience creating implementation guides runbooks production support documentation and knowledge transfer materials
Ability to independently lead offshore execution while collaborating closely with onshore and customer teams
Preferred Skills
Databricks Data Engineer AssociateProfessional or equivalent practical certification
Experience with MLOps MLflow model registry model serving or Databricks platform extensions
Experience with usage reporting dashboarding cost tracking and FinOps operational support
Exposure to enterprise data governance security controls platform observability and production support models
Experience supporting postimplementation stabilization and steadystate platform operations
Expected Deliverables
Configured Databricks platform components based on approved implementation backlog
Reusable Terraformautomation modules and deployment scripts
Working CICD pipelines for Databricks assets and environment promotion
Unity Catalog configuration artifacts access control documentation and validation evidence
Databricks SQL warehouse setup documentation performance notes and operational checks
Monitoring ing FinOps support reports and platform support runbooks
Free courses, interview questions and practice for each skill.
Work from Office
Full Time
Zettamine Labs
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Hyderabad, Pune, Bengaluru
10.0 - 18.0 Lacs P.A.
Hyderabad, Pune, Bengaluru
10.0 - 18.0 Lacs P.A.
AI Job Matching Summary