Data Engineering Lead

6 years

0 Lacs

Posted:5 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Key Responsibilities:

  • Lead and mentor a team of data engineers across projects and ensure high-quality delivery.
  • Design, build, and optimize large-scale data pipelines and data integration workflows using

    ADF

    and

    Synapse Analytics

    .
  • Architect and implement scalable data solutions on

    Azure cloud

    , including

    Databricks

    and

    Microsoft Fabric

    .
  • Write efficient and maintainable code using

    PySpark and SQL

    for data transformations and processing.
  • Collaborate with data architects, analysts, and business stakeholders to define data strategies and requirements.
  • Implement and advocate for

    Data Mesh

    principles within the organization.
  • Provide architectural guidance and perform solutioning for new and existing data projects on Azure.
  • Ensure data quality, governance, and security best practices are followed.
  • Stay updated with evolving Azure services and data technologies.

Required Skills & Experience:

  • 6+ years

    of professional experience in data engineering and solution architecture.
  • Expertise in

    Azure Data Factory (ADF)

    and

    Azure Synapse Analytics

    .
  • Strong hands-on experience with

    Databricks

    ,

    PySpark

    , and advanced

    SQL

    .
  • Good knowledge of

    Microsoft Fabric

    and its use cases.
  • Deep understanding of

    Azure cloud services

    related to data storage, processing, and integration.
  • Familiarity with

    Data Mesh architecture

    and distributed data product ownership.
  • Strong problem-solving and debugging skills.
  • Excellent communication and stakeholder management abilities.

Good to Have:

  • Experience with CI/CD pipelines for data solutions.
  • Knowledge of data security and compliance practices on Azure.
  • Certification in Azure Data Engineering or Solution Architecture.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Celebal Technologies logo
Celebal Technologies

Technology Consulting and Services

Ahmedabad

RecommendedJobs for You

thiruvananthapuram, kerala

Gurugram, Haryana, India

Trivandrum, Kerala, India

Kochi, Kerala, India