Home
Jobs

Lead Data Engineer

10 years

0 Lacs

Posted:23 hours ago| Platform: Linkedin logo

Apply

Work Mode

Remote

Job Type

Full Time

Job Description

Job Title:

Experience:

Location:

Mandatory:

About the Role:

Lead Data Engineer


Key Responsibilities:

  • Lead the design and development of

    data pipelines

    (batch and real-time) using

    Azure, Snowflake, DBT, Python

    , and

    Fivetran

    .
  • Translate complex business and data requirements into scalable, efficient data engineering solutions.
  • Architect multi-cluster

    Snowflake

    setups with an eye on performance and cost.
  • Design and implement robust

    CI/CD pipelines

    for data workflows (Git-based).
  • Collaborate closely with analysts, architects, and business teams to ensure data architecture aligns with organizational goals.
  • Mentor and review work of onshore/offshore data engineers.
  • Define and enforce

    coding standards, testing frameworks, monitoring strategies

    , and data quality best practices.
  • Handle

    real-time data processing

    scenarios where applicable.
  • Own end-to-end delivery and documentation for data engineering projects.


Must-Have Skills:

  • Fivetran

    : Proven experience integrating and managing Fivetran connectors and sync strategies.
  • Snowflake Expertise

    :
  • Warehouse management, cost optimization, query tuning
  • Internal vs. external stages, loading/unloading strategies
  • Schema design, security model, and user access
  • Python

    (advanced): Modular, production-ready code for ETL/ELT, APIs, and orchestration
  • DBT

    : Strong command of DBT for transformation workflows and modular pipelines

Azure

  • Azure Data Factory (ADF), Databricks
  • Integration with Snowflake and other services
  • SQL

    : Expert-level SQL for transformations, validations, and optimizations
  • Version Control

    : Git, branching, pull requests, and peer code reviews
  • CI/CD

    : DevOps/DataOps workflows for data pipelines
  • Data Modeling

    : Star schema, Data Vault, normalization/denormalization techniques
  • Strong documentation using Confluence, Word, Excel, etc.
  • Excellent communication skills – verbal and written


Good to Have:

  • Experience with

    real-time data streaming

    tools (Event Hub, Kafka)
  • Exposure to

    monitoring/data observability

    tools
  • Experience with

    cost management strategies

    for cloud data platforms
  • Exposure to Agile/Scrum-based environments

Mock Interview

Practice Video Interview with JobPe AI

Start Data Interview Now
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Cozzera
Cozzera

278 Jobs

RecommendedJobs for You