5 - 15 years

3 - 7 Lacs

Posted:6 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are seeking a

Senior Data Engineer

with expertise in

Databricks, ETL pipeline development, and real-time data processing

. The ideal candidate will be responsible for

designing, developing, and optimizing data workflows

, ensuring

seamless data integration

and processing. This role requires a deep understanding of

SQL, data modeling, and cloud-based data solutions

, as well as the ability to mentor junior developers and collaborate with key stakeholders.

Key Responsibilities:



  • Develop

    ETL pipelines, data workflows, and real-time processing solutions

    using

    Databricks and Delta Live Tables (DLT)

    .

  • Design and implement

    data models, data lakes, and data warehouses

    for optimized storage and retrieval.

  • Write and optimize

    complex SQL queries

    to support data extraction, transformation, and analytics.

  • Work closely with

    stakeholders, business SMEs, and QA teams

    to ensure data accuracy and integrity.

  • Provide

    technical guidance and mentorship

    to junior developers.

  • Ensure data pipelines are

    scalable, efficient, and aligned with business needs

    .

  • Troubleshoot data issues and

    optimize performance

    of ETL processes.

  • Stay up to date with

    emerging data technologies

    and best practices in

    big data and cloud computing

    .


Requirements:



  • 5+ years

    of experience in

    data engineering, ETL development, and data processing

    .

  • Strong expertise in

    Databricks and Delta Live Tables (DLT)

    .

  • Proficiency in

    SQL

    with experience in writing

    complex queries and performance tuning

    .

  • Experience with

    data lakes, data modeling, and data warehousing solutions

    .

  • Familiarity with

    cloud platforms (AWS, Azure, or GCP)

    for data pipeline development.

  • Hands-on experience with

    real-time data streaming and processing

    .

  • Strong problem-solving and analytical skills.

  • Excellent

    communication and collaboration skills

    to work effectively with cross-functional teams.


Preferred Qualifications:



  • Experience with

    Apache Spark and big data technologies

    .

  • Knowledge of

    CI/CD pipelines for data pipeline automation

    .

  • Hands-on experience with

    Python or Scala for data processing

    .

  • Experience in

    mentoring junior team members

    and conducting code reviews.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

Andhra Pradesh, India