Jobs
Interviews
DataE2E Technologies logo

Senior Databricks SME

7 years

0 Lacs

India

Posted:1 week ago| Platform: Linkedin logo

Apply

Skills Required

databricks data architecture reliability design etl pyspark aws azure storage governance devops drive pipeline deployment engineering apache spark gcp containerization orchestration

Work Mode

Remote

Job Type

Full Time

Job Description

Job Title:

Location:

Job Type:


About the Role:

Senior Databricks SME


Key Responsibilities:

  • Design, build, and manage large-scale data pipelines and ETL/ELT workflows in

    Databricks

    using

    PySpark/Scala

    .
  • Develop scalable data solutions using

    Python

    and

    SQL

    across diverse cloud environments (AWS, Azure, or GCP).
  • Implement and optimize data lakes, data warehouses, and data mesh architectures using modern storage formats like

    Parquet

    ,

    Avro

    , and

    Delta Lake

    .
  • Ensure data governance, observability, and quality across all stages of the data lifecycle.
  • Collaborate with data architects, analysts, and DevOps teams to drive architecture design, pipeline performance, and deployment practices.
  • Optionally, utilize

    Docker

    and

    Kubernetes

    for containerized data engineering workflows.


Required Skills:

  • Experience in

    data engineering

    , including, 7+ years in

    Databricks

    production environments.
  • Strong hands-on expertise in

    Python

    ,

    SQL

    , and

    Apache Spark (PySpark/Scala)

    .
  • Experience working with

    cloud platforms

    (AWS, Azure, or GCP) and building cloud-native data pipelines.
  • Deep understanding of

    data lake

    ,

    data warehouse

    , and

    data mesh

    principles.
  • Proficiency with file formats like

    Parquet

    ,

    Avro

    , and

    Delta Lake

    .
  • Familiarity with containerization and orchestration tools (

    Docker

    ,

    Kubernetes

    ) is a plus.
  • Solid grasp of

    data quality

    ,

    observability

    , and

    governance best practices

    .

More Jobs at DataE2E Technologies

Databricks Engineer (Airflow)

India

7.0 - 7.0 yrs
|

Salary: Not disclosed

Azure Databricks Engineer

India

4.0 - 4.0 yrs
|

Salary: Not disclosed

Machine Learning Engineer

India

5.0 - 5.0 yrs
|

Salary: Not disclosed

AI/ML Engineer

India

5.0 - 5.0 yrs
|

Salary: Not disclosed

Machine Learning Engineer

India

5.0 - 5.0 yrs
|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
DataE2E Technologies logo
DataE2E Technologies

RecommendedJobs for You

DataE2E Technologies logo

Senior Databricks SME

DataE2E Technologies

India

DataE2E Technologies logo

Senior Databricks SME

DataE2E Technologies

India