Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in chennai
>
Wroots Global
>
Data Engineer-Apache Spark

Data Engineer-Apache Spark

Wroots Global

6 - 10 years

25 - 27 Lacs

chennai bengaluru

Posted:2 days ago| Platform:

Apply

Skills Required

hive apache spark python

Work Mode

Hybrid

Job Type

Full Time

Job Description

Immediate Joiners-Preferred

Contact

Amreen-6304949975

Rajeshwari-8105657937

Tejaswini-6301629162

Role Summary

We are seeking Senior Data Engineer resources to work on the migration of applications from

our legacy Cloudera environment to the new Kubernetes-based data platform. The role requires

strong hands-on development skills in data engineering, with the ability to deliver high-quality

pipelines under guidance from internal leads.

Key Responsibilities

Develop and optimize data pipelines using Spark 3.5 and Python/Scala.

Migrate existing Hive, Spark, and Control-M jobs to Airflow and DBT-based workflows.

Integrate data pipelines with messaging systems (Kafka, Solace) and object stores (S3,

MinIO).

Troubleshoot and optimize distributed jobs running in Kubernetes environments.

Collaborate closely with internal leads and architects to implement best practices.

Design and implement migration/acceleration framework to automate end to end

migration.

Continuous enhancements to the frameworks to ensure the stability, scalability and

support for diverse use cases and scenarios.

Work with various data applications to enable and support the migration process.

Deliver assigned migration tasks within agreed timelines.

Required Skills

6 9 years of hands-on data engineering experience.

Strong expertise in Apache Spark (batch + streaming) and Hive.

Proficiency in Python, Scala, or Java.

Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation

frameworks (DBT preferred).

Experience working with Kafka, Solace, and object stores (S3, MinIO).

Exposure to Docker/Kubernetes for deployment.

Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

INTERNAL

Engagement Expectations

Vendor resource will be expected to work independently on assigned modules and

deliver production-ready solutions.

Must participate in daily/weekly status calls, reviews, and issue resolution.

Should adapt to client processes, documentation standards, and compliance

requirements.

More Jobs at Wroots Global

Hiring For Customer Support/ Tele Sales/ Tele Collections

Bengaluru

Experience: Not specified

INR 0 - 3 Lacs

Senior Data Engineer

Pune, Mumbai (All Areas)

5 - 7 yrs

INR 15 - 25 Lacs

Wipro - Java Full Stack Developer (Java + Angular)

Chennai

6 - 10 yrs

INR 20 - 25 Lacs

HCL-Java Developer -Face To Face interview DRIVE

Bangalore Rural, Bengaluru

5 - 10 yrs

INR 10 - 20 Lacs

Wipro - Adobe Experience Manager Full Stack Developer

Bengaluru

4 - 9 yrs

INR 15 - 27 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Wroots Global

Logistics and Supply Chain

Metropolis

RecommendedJobs for You

Data Engineer-Apache Spark

Wroots Global

chennai, bengaluru

Lead Assistant Manager-Data Engineering-Big Data Engineering

EXL

gurugram

Data Engineer

Payu India

bengaluru

Senior Data Engineer

Quantiphi Analytics Solutions

mumbai, bengaluru

DTICI_Snowflake_Data_engineer_T8

Daimler Trucks Innovation Center

bengaluru

Technical Specialist - Data Engineer

Lanxess

thane

data engineer

Deeporion Technology

jaipur

Data Tester

Myridius x Aethereus

chennai

Sr Analyst I Data Engineering

DXC Technology

pune

CDP -Data Engineer

Biz Hr It Solutions

pune, bengaluru, mumbai (all areas)

Before You Leave... Find Your Perfect Job!

Login to

Please Verify Your Phone or Email

Confirm Action

Contact Us

Data Engineer-Apache Spark

Experience & Salary

Skills Required

Work Mode

Job Type

Job Description

Role Summary

We are seeking Senior Data Engineer resources to work on the migration of applications from

our legacy Cloudera environment to the new Kubernetes-based data platform. The role requires

strong hands-on development skills in data engineering, with the ability to deliver high-quality

pipelines under guidance from internal leads.

Key Responsibilities

Develop and optimize data pipelines using Spark 3.5 and Python/Scala.

Migrate existing Hive, Spark, and Control-M jobs to Airflow and DBT-based workflows.

Integrate data pipelines with messaging systems (Kafka, Solace) and object stores (S3,

MinIO).

Troubleshoot and optimize distributed jobs running in Kubernetes environments.

Collaborate closely with internal leads and architects to implement best practices.

Design and implement migration/acceleration framework to automate end to end

migration.

Continuous enhancements to the frameworks to ensure the stability, scalability and

support for diverse use cases and scenarios.

Work with various data applications to enable and support the migration process.

Deliver assigned migration tasks within agreed timelines.

Required Skills

6 9 years of hands-on data engineering experience.

Strong expertise in Apache Spark (batch + streaming) and Hive.

Proficiency in Python, Scala, or Java.

Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation

frameworks (DBT preferred).

Experience working with Kafka, Solace, and object stores (S3, MinIO).

Exposure to Docker/Kubernetes for deployment.

Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

INTERNAL

Engagement Expectations

Vendor resource will be expected to work independently on assigned modules and

deliver production-ready solutions.

Must participate in daily/weekly status calls, reviews, and issue resolution.

Should adapt to client processes, documentation standards, and compliance

requirements.

More Jobs at Wroots Global