Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in bengaluru
>
Ness Digital Engineering
>
Senior Data Engineer

Senior Data Engineer

Ness Digital Engineering

3 - 8 years

5 - 10 Lacs

bengaluru

Posted:Just now| Platform:

Apply

Skills Required

performance tuning data migration metadata delta rdbms data modeling debugging data quality big data sql

Work Mode

Work from Office

Job Type

Full Time

Job Description

As a Ness employee, you will be working on products and platforms for some of the most innovative software companies in the world.

You ll gain knowledge working alongside other highly skilled professionals that will help accelerate your career progression.

You ll also benefit from an array of advantages like access to trainings and certifications, bonuses, and aids, socializing activities and attractive compensation.

Key Responsibilities:

Design, develop, and optimize ETL pipelines in PySpark and SQL within the Databricks environment.
Re-engineer existing ETL workflows running on Postgres to leverage Databricks Notebooks and Delta Lake architecture .
Implement and manage the Bronze Silver Gold data model.
Generate extract files using a metadata catalog that maps Delta columns to destination Postgres schema.
Collaborate with Data Architects/Engineers, POs and DevOps to implement scalable and secure data pipelines.
Contribute to cost optimization by eliminating legacy Postgres workflows.
Ensure data quality, lineage and performance optimization at every stage.

Required Skills:

Proven expertise in PySpark , Databricks , and Delta Lake .
Strong proficiency in SQL and data transformation logic.
Hands-on experience with data migration from RDBMS (Postgres) to big data platforms .
Solid understanding of data modeling (especially multi-layer architectures) .
Experience in developing or consuming data catalogs .
Proficient in debugging and performance tuning in distributed environments.

More Jobs at Ness Digital Engineering

Microsoft API Architect

Hyderabad, Telangana

Experience: Not specified

Salary: Not disclosed

VP of Business Development

Hyderabad, Telangana, India

15.0 - 15.0 yrs

Salary: Not disclosed

Business Development Executive

Pune, Maharashtra, India

5.0 - 5.0 yrs

Salary: Not disclosed

Visual Designer – UI & Marketing Design

Pune, Maharashtra

8.0 - 8.0 yrs

Salary: Not disclosed

UIPath Developer – OCR & Document Processing Specialist (UiPath)

Hyderābād

3.0 - 3.0 yrs

INR 7 - 10 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Big Data Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

Ness Digital Engineering

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Senior Data Engineer