Mastech Digital logo

Databricks Lead - Data Engineering

8 years

0 Lacs

chennai tamil nadu india

Posted:1 day ago| Platform: Linkedin logo

Apply

Skills Required

databricks data engineering leadership development spark drive coding devops governance security compliance unity pyspark sql aws azure gcp orchestration git terraform communication certifications kafka mlflow cutting collaborative compensation

Work Mode

On-site

Job Type

Full Time

Job Description

Description

Job Title :

Databricks Lead.

Location :

: 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects.

Budget :

Open to discuss.

Notice Period :

Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 days.

About The Role

We are looking for a highly skilled Databricks Lead with 810 years of overall experience and 5+ years of hands-on leadership in data engineering projects.The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks, Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse/Medallion architectures (Bronze/Silver/Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI/CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 810 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks, Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS/Azure/GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI/CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.

Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.

What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
(ref:hirist.tech)

More Jobs at Mastech Digital

Reltio Architect

India

5 - 5 yrs
|

Salary: Not disclosed

Staff Engineer- Java

Bengaluru

12.0 - 18.0 yrs
|

INR 15 - 30 Lacs

Innovation Lead/Artificial Intelligence

Chennai, Tamil Nadu, India

Experience: Not specified

|

Salary: Not disclosed

US Payroll Assistant Manager

Noida, Uttar Pradesh, India

6.0 - 6.0 yrs
|

Salary: Not disclosed

US Revenue Assistant Manager

Chennai, Tamil Nadu, India

6.0 - 6.0 yrs
|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Mastech Digital logo
Mastech Digital

Information Technology & Staffing Services

Pittsburgh

RecommendedJobs for You

Mastech Digital logo

Databricks Lead - Data Engineering

Mastech Digital

chennai, tamil nadu, india

Mastech Digital logo

Databricks Lead - Data Engineering

Mastech Digital

chennai, tamil nadu, india