Pyspark Lead

Wipro

5 - 8 years

7 - 11 Lacs

pune

Posted:4 days ago| Platform:

Apply

Skills Required

pyspark spark streaming apache spark etl hive bigdata frameworks scala amazon redshift apache pig apache zookeeper sql rspec java flume hadoop big data digital transformation mongodb hbase python oozie mapreduce kafka sqoop

Work Mode

Work from Office

Job Type

Full Time

Job Description

Position Overview

We are seeking a skilled and experienced Senior PySpark Developer with expertise in Apache spark, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments.

Required Skills and Qualifications

Experience
: 7+ years of professional experience in PySpark development.
Technical Skills
:
- Strong proficiency in
  PySpark
- Deep understanding of Apache Spark architecture, distributed computing concepts and parallel processing.
- Proven experience in building and optimizing complex ETL pipeline using PySpark
- Experience with various spark components

Expertise in
Spark Batch
for large-scale data processing and analytics.
Experience with
Spark Streaming
for real-time data processing and streaming pipelines.
Familiarity with distributed computing concepts and big data frameworks.

Mandatory Skills: PySpark.Experience: 5-8 Years.

More Jobs at Wipro

Data Scientist + Operational Research /Optimization

Pune, Bengaluru, Mumbai (All Areas)

5 - 10 yrs

INR 10 - 19 Lacs

Developer - L4

Pune

5 - 8 yrs

INR 7 - 9 Lacs

Principal Consultant - Tech & Impl - L1

Pune

8 - 10 yrs

INR 20 - 25 Lacs

Customer Support Associate - International Voice Process

Kolkata

Experience: Not specified

INR 2 - 4 Lacs

Customer Support Associate - International Non-Voice Process

Kolkata

Experience: Not specified

INR 2 - 2 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.