PySpark With Scala (3-20 Years)

Infosys

3 - 8 years

15 - 30 Lacs

hyderabad pune bengaluru

Posted:Just now| Platform:

Apply

Skills Required

pyspark scala spark python big data

Work Mode

Hybrid

Job Type

Full Time

Job Description

Big Data Developer

data processing pipelines

Key Responsibilities:

Develop and maintain
data pipelines
using
Apache Spark
,
Scala
, and
PySpark
.
Apply
functional programming principles
for clean and efficient Scala code.
Optimize Spark jobs for
performance
,
cost efficiency
, and
scalability
.
Collaborate with
data engineers
,
data scientists
, and
cloud teams
to deliver robust solutions.
Integrate Spark applications with
data lakes
,
streaming platforms
(Kafka), and
cloud services
.
Implement
unit tests
, perform
code reviews
, and follow best practices in software development.

Required Skills:

Strong proficiency in
Scala
and
Python (PySpark)
.
Hands-on experience with
Apache Spark
(Core, SQL, Streaming).
Knowledge of
functional programming concepts
in Scala.
Familiarity with
data lake architectures
,
HDFS
, and
Hive
.
Proficiency in
SQL
and
data modeling
.
Experience with
CI/CD pipelines
,
Git
, and
cloud platforms
(AWS, Azure, GCP).

Preferred Skills:

Experience with
Databricks
and
Delta Lake
.
Knowledge of
Akka
,
Play Framework
, or
reactive programming
.
Exposure to
containerization
(Docker, Kubernetes).

Location: Bangalore, Hyderabad, Trivandrum, Pune, Bhubaneshwar

Experience: 3-20 Years

More Jobs at Infosys

Automation Test Engineer_Java with Selenium

Chennai, Bengaluru, Hyderabad

3 - 8 yrs

INR 5 - 13 Lacs

Api Tester

Chennai, Pune, Bengaluru

6 - 8 yrs

INR 0 - 1 Lacs

Azure Developer- Bengaluru

Chennai, Bengaluru, Hyderabad

2 - 7 yrs

INR 5 - 15 Lacs

Python Developer-Bengaluru

Chennai, Bengaluru, Hyderabad

2 - 5 yrs

INR 4 - 8 Lacs

Scala Developer

Chennai, Bengaluru, Hyderabad

5 - 10 yrs

INR 6 - 14 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.