Spark Developer (5-10 Years)-Pan India-H

Infosys

5 - 10 years

7 - 17 Lacs

hyderabad pune bengaluru

Posted:1 day ago| Platform:

Apply

Skills Required

spark pyspark hive hdfs apache spark

Work Mode

Hybrid

Job Type

Full Time

Job Description

Spark Developer

Key Responsibilities

Design and implement
Spark-based ETL pipelines
for batch and streaming data.
Optimize Spark jobs for
performance and resource utilization
.
Work with
distributed systems
and big data frameworks (Hadoop, Hive, Kafka).
Collaborate with
data engineers, data scientists, and business teams
to deliver clean, structured data.
Ensure
data quality, reliability, and security
across all processes.
Troubleshoot and resolve issues in
Spark clusters and jobs
.
Integrate Spark applications with
cloud platforms
(AWS, Azure, GCP).

Required Skills & Qualifications

Bachelors/Masters in
Computer Science, Data Engineering, or related field
.
5+ years of experience in
big data development
.
Strong proficiency in
Apache Spark (Core, SQL, Streaming)
.
Expertise in
Scala or Python
for Spark development.
Experience with
Hadoop ecosystem
(HDFS, Hive, YARN).
Familiarity with
data modeling, partitioning, and performance tuning
.
Knowledge of
cloud services
and
containerization (Docker, Kubernetes)
.

More Jobs at Infosys

SAP IBP Consultant

bengaluru

5.0 - 9.0 yrs

INR 6 - 10 Lacs

SAP CO Consultant

bengaluru

5.0 - 7.0 yrs

INR 7 - 11 Lacs

Vision Plus Developer/ Analyst

pune

7.0 - 11.0 yrs

INR 3 - 7 Lacs

VisionPlus Developer

pune

3.0 - 8.0 yrs

INR 4 - 8 Lacs

Angular Consultant

chandigarh

5.0 - 10.0 yrs

INR 6 - 10 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.