Lead I - Data Engineering

5 - 9 years

5 Lacs

Posted:5 hours ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

enior Data Engineer (Azure/Databricks)

Overview

Senior Data Engineer

Key Responsibilities

  • Design, develop, and maintain

    scalable data pipelines

    using

    Azure

    and

    Databricks

    .
  • Build efficient

    data ingestion

    and

    transformation

    workflows with

    PySpark

    and

    Delta Lake

    .
  • Develop, optimize, and maintain

    ETL/ELT pipelines

    using

    Python

    and

    SQL

    .
  • Implement

    data modeling

    ,

    data quality

    , and

    governance

    best practices.
  • Work with

    relational databases

    (e.g., PostgreSQL) and

    lakehouse architectures

    (e.g., Delta Lake).
  • Collaborate with cross-functional teams to

    troubleshoot, optimize, and support

    production workloads.

Required Skills & Experience

  • 5+ years

    of data engineering experience.
  • Strong proficiency in the

    Azure ecosystem

    , including:
    • Azure Databricks

    • Azure Data Lake Storage (ADLS)

    • Azure Functions

    • Azure Data Factory

      (preferred)
  • Advanced PySpark

    and

    SQL

    expertise, including performance tuning.
  • Deep understanding of

    ETL/ELT design patterns

    and

    data warehousing concepts

    .
  • Experience with

    Delta Lake

    (ACID transactions, schema evolution, time travel).
  • Hands-on experience with

    PostgreSQL

    or similar RDBMS.
  • Strong analytical, problem-solving, and communication skills.
  • Self-motivated and comfortable in

    fast-paced

    , agile environments.

Preferred Skills

  • Familiarity with

    CI/CD

    pipelines (Azure DevOps, Git).
  • Knowledge of

    Infrastructure-as-Code

    tools (Terraform).
  • Exposure to

    real-time streaming

    technologies (Kafka, Event Hub).
  • Awareness of

    data governance

    tools (e.g., Microsoft Purview).

Technical Stack

Languages & Tools:

forma

Required Skills

Python,Spark,Azure

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You

pune, thiruvananthapuram

kochi, thiruvananthapuram

trivandrum, kerala, india