Senior Data Engineer

10 years

0 Lacs

Posted:4 days ago| Platform: Linkedin logo

Apply

Work Mode

Remote

Job Type

Full Time

Job Description

Job Title:

Location:

Job Type:

Send Resume To:

Company:

Experience Required:

Job Summary:

Senior Data Engineer

  • Key Responsibilities:

    Design, build, and maintain scalable

    ETL/ELT pipelines

    using

    Azure Data Factory

    ,

    Databricks

    ,

    PySpark

    , and

    SQL

    .
  • Engineer data workflows integrating structured/unstructured data from

    ADLS Gen2

    ,

    Azure Synapse

    ,

    SQL Server

    , and APIs.
  • Optimize

    storage and compute performance

    in Databricks and Delta Lake environments.
  • Implement

    data modeling

    and transformation logic aligned with reporting and machine learning needs.
  • Lead

    end-to-end solutioning

    in Azure with a focus on performance, reliability, and scalability.
  • Collaborate with

    data scientists, analysts, and stakeholders

    to deliver validated and production-ready datasets.
  • Develop and maintain

    CI/CD pipelines

    using

    Azure DevOps

    or

    GitHub Actions

    .
  • Ensure

    compliance with data governance, privacy, and security standards

    .
  • Monitor and troubleshoot data pipelines, ensuring high availability and performance.
  • Mentor junior engineers

    and provide technical leadership.
  • Required Qualifications:

    Bachelor’s in Computer Science, Engineering, or related field (or equivalent work experience).
  • 7+ years of experience in

    data engineering

    , including:
  • Strong hands-on expertise in

    Databricks

    (Delta Lake, orchestration, notebooks).
  • In-depth experience with

    Azure Cloud Services

    (ADF, ADLS Gen2, Synapse, Key Vault).
  • High proficiency in

    Python

    ,

    PySpark

    , and

    SQL

    .
  • Experience building

    lakehouse architectures

    , and designing

    ETL/ELT pipelines

    .
  • Excellent verbal and written

    communication skills

    .
  • Ability to convey technical data concepts to

    non-technical stakeholders

    .
  • Preferred Skills & Technologies:

    (Especially relevant for Databricks-focused projects)Experience with

    data mesh architecture

    and

    distributed data ownership

    .
  • Familiarity with

    event-driven architectures

    : Azure Event Hubs, Kafka.
  • Exposure to

    Databricks Workflows

    ,

    MLflow

    ,

    Unity Catalog

    .
  • Hands-on experience with

    Power BI

    or similar BI/visualization tools.
  • Knowledge of

    Terraform

    or other Infrastructure-as-Code (IaC) tools.
  • Certifications (Preferred):

    Microsoft Certified:

    Azure Data Engineer Associate (DP-203)

  • Databricks Certified Data Engineer

To Apply:


Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You

hyderabad, chennai, bengaluru

hyderabad, telangana, india

hyderabad, telangana, india