Senior Data Engineer- Azure

Tiger Analytics

5 - 10 years

10 - 20 Lacs

hyderabad chennai bengaluru

Posted:2 weeks ago| Platform:

Apply

Skills Required

azure data factory data lakehouse azure databricks azure data lake azure synapse azure data warehouse data lake data warehousing sql azure

Work Mode

Work from Office

Job Type

Full Time

Job Description

Role Overview:

Design and implement scalable, metadata-driven frameworks for data ingestion, quality, and transformation across both batch and streaming datasets.
Develop and optimize end-to-end data pipelines to process structured and unstructured data, enabling the creation of analytical data products.
Build robust exception handling, logging, and monitoring mechanisms for better observability and operational support.
Take ownership of complex modules and lead the development of critical data workflows and components.
Provide guidance to data engineers and peers on best practices.
Collaborate with cross-functional teamsincluding business consultants, data architects, scientists, and application developersto deliver impactful analytics solutions.

Preferred candidate profile

5+ years of overall technical experience, with a minimum of 2 years of hands-on experience with Microsoft Azure and Databricks.
Proven experience delivering at least one end-to-end Data Lakehouse solution on Azure Databricks using the Medallion Architecture.
Strong working knowledge of the Databricks ecosystem, including: PySpark, Notebooks, Structured Streaming, Unity Catalog, Delta Live Tables, Workflows, and SQL Warehouse.
Advanced programming, unit testing, and debugging skills in Python and SQL.
Hands-on experience with Azure-native services such as: Azure Data Factory, ADLS Gen2, Azure SQL Database, and Event Hub.
Solid understanding of data modeling techniques, including both Dimensional and Third Normal Form (3NF) models.
Exposure to developing LLM/Generative AI-powered applications.
Must have excellent understanding of CI/CD workflows using Azure DevOps.
Bonus: Knowledge of Azure infrastructure, including provisioning, networking, security, and governance.

Educational Background:

Bachelors degree (B.E/B.Tech) in Computer Science, Information Technology, or a related field from a reputed institute (preferred).

You are important to us, lets stay connected!

More Jobs at Tiger Analytics

Senior / Lead AI

Hyderabad, Chennai, Bengaluru

5 - 9 yrs

INR 17 - 30 Lacs

Senior/Lead AI

Hyderabad, Chennai, Bengaluru

8 - 10 yrs

INR 20 - 35 Lacs

Data Scientist/Senior Data Scientist

Hyderabad, Chennai, Bengaluru

3 - 8 yrs

INR 18 - 30 Lacs

Associate Principal - Data Scientist

Hyderabad, Chennai, Bengaluru

8 - 13 yrs

INR 30 - 45 Lacs

MLOps Databricks Engineer

Hyderabad, Chennai, Bengaluru

6 - 10 yrs

INR 12 - 22 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.