Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in bengaluru
>
Ness Digital Engineering
>
Senior Data Engineer

Senior Data Engineer

Ness Digital Engineering

5 - 10 years

0 Lacs

bengaluru

Posted:4 months ago| Platform:

Apply

Skills Required

metadata modeling access delta pyspark data pipeline data migration sql data modeling postgresql optimization devops debugging data transformation etl big data architecture rdbms performance tuning workflow data engineering data bricks data quality environment logic

Work Mode

Work from Office

Job Type

Full Time

Job Description

Why Ness

We know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most innovative software companies in the world.

You’ll gain knowledge working alongside other highly skilled professionals that will help accelerate your career progression.

You’ll also benefit from an array of advantages like access to trainings and certifications, bonuses, and aids, socializing activities and attractive compensation.

Key Responsibilities:

Design, develop, and optimize ETL pipelines in PySpark and SQL within the Databricks environment.
Re-engineer existing ETL workflows running on Postgres to leverage Databricks Notebooks and Delta Lake architecture.
Implement and manage the Bronze Silver Gold data model.
Generate extract files using a metadata catalog that maps Delta columns to destination Postgres schema.
Collaborate with Data Architects/Engineers, POs and DevOps to implement scalable and secure data pipelines.
Contribute to cost optimization by eliminating legacy Postgres workflows.
Ensure data quality, lineage and performance optimization at every stage.

Required Skills:

Proven expertise in PySpark, Databricks, and Delta Lake.
Strong proficiency in SQL and data transformation logic.
Hands-on experience with data migration from RDBMS (Postgres) to big data platforms.
Solid understanding of data modeling (especially multi-layer architectures).
Experience in developing or consuming data catalogs.
Proficient in debugging and performance tuning in distributed environments.

Not checking every single requirement?

If this role sounds good to you, even if you don’t meet every single bullet point in the job description, we encourage you to apply anyway. For most of the candidates that applied, we found a role that was a very good fit with their skills.

Let’s meet and you may just be the right candidate for one of our roles.

At Ness Digital Engineering we are willing to build a work culture that is based on diversification, inclusion, and authenticity.

More Jobs at Ness Digital Engineering

Microsoft API Architect

Hyderabad, Telangana

Experience: Not specified

Salary: Not disclosed

VP of Business Development

Hyderabad, Telangana, India

15.0 - 15.0 yrs

Salary: Not disclosed

Business Development Executive

Pune, Maharashtra, India

5.0 - 5.0 yrs

Salary: Not disclosed

Visual Designer – UI & Marketing Design

Pune, Maharashtra

8.0 - 8.0 yrs

Salary: Not disclosed

UIPath Developer – OCR & Document Processing Specialist (UiPath)

Hyderābād

3.0 - 3.0 yrs

INR 7 - 10 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

Ness Digital Engineering

Login to

Please Verify Your Phone or Email

Confirm Action

Senior Data Engineer