PySpark Streaming Developer

5 - 7 years

5 - 7 Lacs

Posted:1 day ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Immediate Hiring PySpark Streaming Developer (5+ Years Exp) | Full-Time | Multiple Locations: Hyderabad, Bangalore, Gurgaon, Mumbai, Chennai, Kolkata, Pune


We are seeking a highly skilled PySpark Streaming Developer with expertise in real-time data processing for handling continuous data streams. The ideal candidate should be proficient in PySpark Structured Streaming, enabling seamless ingestion, transformation, and analysis of data from various sources like Kafka, web APIs, and sensor feeds, while integrating efficiently with databases and dashboards.


Key Responsibilities:

- Develop & optimize real-time data processing pipelines
- Implement Structured Streaming with PySpark for large-scale data processing- Work with data sources like Kafka, Kinesis, WebSockets, and file systems- Apply data transformations (filtering, aggregation, windowing, joins)- Ensure seamless data ingestion, transformation, and analysis- Integrate processed data into databases, data lakes, and live dashboards- Optimize performance, scalability, and fault tolerance in streaming applications


Primary Skills:-- PySpark & Structured Streaming expertise-- Real-time data processing & ingestion (Kafka, Kinesis, WebSockets, etc.)-- Transformations: Filtering, aggregation, windowing, joins-- Integration with databases, data lakes, and visualization tools-- Strong coding skills in Python & PySpark


Secondary Skills (Nice to Have):- Experience with AWS, Azure, or GCP cloud services- Knowledge of Delta Lake, Apache Flink, or Apache Beam- Understanding of CI/CD pipelines for data workflows- Strong problem-solving & debugging skills-- Interested candidates, please share your resumes with current CTC, expected CTC, location, and notice period.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Strategic Skill Tech logo
Strategic Skill Tech

Technology Consulting

Silicon Valley

RecommendedJobs for You