Spark Developer (4-12 years)

Infosys

3 - 8 years

4 - 9 Lacs

hyderabad pune bengaluru

Posted:2 hours ago| Platform:

Apply

Skills Required

spark spark core pyspark spark programming spark streaming

Work Mode

Hybrid

Job Type

Full Time

Job Description

Apache Spark Developer

distributed computing

Key Responsibilities:

Design and implement
data processing pipelines
using Apache Spark (Core, SQL, Streaming).
Develop and optimize
ETL workflows
for large-scale data ingestion and transformation.
Work with
Spark on Hadoop
,
Databricks
, or
cloud-based Spark environments
.
Collaborate with
data engineers
,
data scientists
, and
business teams
to deliver analytics solutions.
Ensure
data quality
,
security
, and compliance standards.
Perform
performance tuning
and
job optimization
for Spark applications.
Integrate Spark with
data lakes
,
data warehouses
, and
streaming platforms
(Kafka).

Required Skills:

Strong proficiency in
Apache Spark
(Core, SQL, Streaming).
Hands-on experience with
PySpark
or
Scala
for Spark development.
Knowledge of
HDFS
,
Hive
, and
data lake architectures
.
Familiarity with
cloud platforms
(AWS EMR, Azure HDInsight, GCP Dataproc).
Proficiency in
SQL
and
data modeling
.

Preferred Skills:

Experience with
Databricks
and
Delta Lake
.
Knowledge of
Kafka
,
Airflow
, or other orchestration tools.
Exposure to
machine learning pipelines
in Spark MLlib.

More Jobs at Infosys

Automation Test Engineer_Java with Selenium

Chennai, Bengaluru, Hyderabad

3 - 8 yrs

INR 5 - 13 Lacs

Api Tester

Chennai, Pune, Bengaluru

6 - 8 yrs

INR 0 - 1 Lacs

Azure Developer- Bengaluru

Chennai, Bengaluru, Hyderabad

2 - 7 yrs

INR 5 - 15 Lacs

Python Developer-Bengaluru

Chennai, Bengaluru, Hyderabad

2 - 5 yrs

INR 4 - 8 Lacs

Scala Developer

Chennai, Bengaluru, Hyderabad

5 - 10 yrs

INR 6 - 14 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.