Senior Data engineer

2 - 6 years

5 - 9 Lacs

Posted:-1 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management.

 

Core Responsibilities:

  • Build and manage high-volume data pipelines using Spark/Databricks.
  • Implement ELT frameworks using Azure Data Factory/Synapse Pipelines.
  • Optimize large-scale datasets in Delta/Iceberg formats.
  • Implement robust data quality, monitoring, and governance layers.
  • Collaborate with Data Scientists, Analysts, and Business stakeholders.

Technical Stack:

  • Big Data:

    Apache Spark, Kafka, Hive, Airflow, Hudi/Iceberg
  • Cloud:

    Azure (Synapse, ADF, ADLS Gen2), Databricks, AWS (Glue/S3)
  • Languages:

    Python, Scala, SQL
  • Storage Formats:

    Delta Lake, Iceberg, Parquet, ORC
  • CI/CD:

    Azure DevOps, Terraform (infra as code), Git

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Milestone Technologies, Inc logo
Milestone Technologies, Inc

Information Technology and Services

San Jose

RecommendedJobs for You

Bangalore Urban, Karnataka, India

Chennai, Tamil Nadu, India

Hyderabad / Secunderabad, Telangana, Telangana, India