Lead Azure Data Engineer

6 - 10 years

15 - 27 Lacs

Posted:1 week ago| Platform: Naukri logo

Apply

Work Mode

Hybrid

Job Type

Full Time

Job Description

Azure Databricks Lead (Sr. Data Engineer)

Who we are

Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset.

Working at Tiger, youll be at the heart of this AI revolution. Youll work with teams that push the boundaries of what-is-possible and build solutions that energize and inspire. We are headquartered in the Silicon Valley and have our delivery centers across the globe.

Role Overview:

We are seeking street-smart and technically strong Senior Data Engineers / Leads who can take ownership of designing and developing cutting-edge data and AI platforms using Azure-native technologies and Databricks. You will play a critical role in building scalable data pipelines, modern data architectures, and intelligent analytics solutions.

Key Responsibilities:

  • Design and implement scalable, metadata-driven frameworks for data ingestion, quality, and transformation across both batch and streaming datasets.
  • Develop and optimize end-to-end data pipelines to process structured and unstructured data, enabling the creation of analytical data products.
  • Build robust exception handling, logging, and monitoring mechanisms for better observability and operational support.
  • Take ownership of complex modules and lead the development of critical data workflows and components.
  • Provide guidance to data engineers and peers on best practices.
  • Collaborate with cross-functional teamsincluding business consultants, data architects & scientists, and application developers—to deliver impactful analytics solutions.

Required Qualifications:

  • 5+ years

    of overall technical experience, with a minimum of

    2 years

    of hands-on experience with Microsoft Azure and Databricks.
  • Proven experience delivering at least one end-to-end

    Data Lakehouse

    solution on Azure Databricks using the Medallion Architecture.
  • Strong working knowledge of the

    Databricks ecosystem

    , including: PySpark, Notebooks, Structured Streaming, Unity Catalog, Delta Live Tables, Workflows, and SQL Warehouse.
  • Advanced

    programming

    , unit testing, and debugging skills in Python and SQL.
  • Hands-on experience with

    Azure-native services

    such as: Azure Data Factory, ADLS Gen2, Azure SQL Database, and Event Hub.
  • Solid understanding of

    data modeling techniques

    , including both Dimensional and Third Normal Form (3NF) models.
  • Exposure to developing

    LLM/Generative AI

    -powered applications.
  • Must have excellent understanding of

    CI/CD workflows

    using Azure DevOps.
  • Bonus: Knowledge of Azure infrastructure, including provisioning, networking, security, and governance.

Educational Background:

  • Bachelor’s degree (B.E/B.Tech) in Computer Science, Information Technology, or a related field from a reputed institute (preferred).

You are important to us, let’s stay connected!

Every individual comes with a different set of skills and qualities so even if you don’t tick all the boxes for the role today we urge you to apply as there might be a suitable/unique role for you tomorrow. We are an equal- opportunity employer. Our diverse and inclusive culture and values guide us to listen, trust, respect, and encourage people to grow the way they desire, packages are among the best in industry.

Note:

Additional Benefits: Health insurance (self & family), virtual wellness platform, Car Lease Program and knowledge communities.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Tiger Analytics logo
Tiger Analytics

Business Consulting and Services

Santa Clara CA

RecommendedJobs for You