Data engineer

6 - 9 years

Gurugram

Posted:7 hours ago

Job Description

Role & responsibilities

Build and maintain data pipelines in Azure Databricks using PySpark and SQL.
• Ingest data from databases, files, APIs and streaming sources into Azure Data Lake Storage.• Organize data in Delta Lake using Bronze, Silver and Gold layers.• Schedule and monitor pipelines with Databricks Workflows or Azure Data Factory.• Check data quality and fix pipeline failures quickly.• Tune jobs and cluster settings for speed and cost.• Set up access and permissions with Unity Catalog and Azure security tools.• Document pipelines and work with analysts and business teams on their data needs.

Required skills:

Hands-on experience with Azure Databricks, including notebooks, clusters and jobs.
• Strong SQL and solid Python (PySpark) for transforming large data.• Working knowledge of Delta Lake and data warehousing concepts.• Experience with Azure services: Data Lake Storage, Data Factory and Key Vault.• Understanding of ETL and ELT design, including batch and incremental loads.• Version control with Git and basic CI/CD practice.• Clear communication with both technical and non-technical colleagues.

Skills Required

Azure Databricks Python Bfsi Data Engineering Banking Process Microsoft Azure SQL Process

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
EXL logo
EXL

Business Process Management / Analytics

New York

RecommendedJobs for You

T

Data engineer

Trueview Technologies

Bengaluru

V

Data engineer

ViEntitydata Technologies

Chennai

T

Data engineer

Trueview Technologies

Bengaluru

V

Data engineer

ViEntitydata Technologies

Chennai