CareerFit.ai logo

Senior Data Engineer II

CareerFit.ai

5 - 10 years

25 - 30 Lacs

Mumbai Gurugram Bengaluru

Posted:19 hours ago

Job Description

Senior Data Engineer II

Location:

About the Role

This is a client-facing Senior Data Engineer role where you'll design and deploy scalable data pipelines, lead cloud migration initiatives, and act as a trusted technical partner to clients on their data platform modernization journeys. You'll work hands-on with Databricks, Spark, and AWS to build governed, high-performance lakehouse architectures, while also guiding and mentoring engineers on your project team.

What You Will Do

  1. Design and deploy scalable data pipelines handling JSON, Parquet, CSV, and ORC formats for both batch and streaming ingestion
  2. Build high-performance Spark pipelines to support cloud migration initiatives
  3. Architect and maintain Medallion Architecture frameworks (Bronze, Silver, Gold tables)
  4. Optimize on-premises Spark codebases for cloud environments
  5. Establish data modeling practices aligned with governance standards
  6. Implement data cataloging using Unity Catalog for data integrity and quality
  7. Build and manage Delta Live Tables (DLT) pipelines for secure data operations
  8. Partner directly with clients to shape cloud migration strategy and enforce best practices in design and governance
  9. Guide and mentor engineers on your project as a technical lead

What We're Looking For

  1. Minimum 5 years of hands-on data engineering experience, including complex pipeline development and cloud migration projects
  2. Bachelor's degree (BE/B.Tech) in Computer Science, Data Engineering, or a closely related field
  3. Advanced proficiency in Spark, SQL, and Python
  4. Hands-on experience with Databricks (Unity Catalog, Delta Live Tables, Medallion Architecture)
  5. Solid working knowledge of AWS services; exposure to GCP or Azure is a plus
  6. Strong communication skills for direct client engagement
  7. Cloud certification (AWS/GCP/Azure Data Engineering) preferred but not mandatory

Skills Required

Senior SQL AWS Pipeline Design Data Pipeline Python Spark

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Hybrid

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
CareerFit.ai logo
CareerFit.ai

RecommendedJobs for You

CareerFit.ai logo

Mumbai, Gurugram, Bengaluru

G
RELX Group logo

Bengaluru

Elsevier logo

Bengaluru

CareerFit.ai logo

Mumbai, Gurugram, Bengaluru

G
RELX Group logo

Bengaluru

Elsevier logo

Bengaluru