Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Pyspark Data Engineer

Krazy Mantra HR Solutions Pvt. Ltd

3 - 8 years

|

3 - 6 Lacs

Posted:2 days ago| Platform:

Apply

Skills Required

hive scala pyspark spark hadoop cloudera confluence big data technologies apache pig sql data modeling linux big data etl hbase jira python github oozie airflow data engineering nosql data quality mapreduce kafka scrum agile sqoop yarn aws unix

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are looking for a skilled Pyspark Data Engineer with 3 to 5 years of experience. The ideal candidate will have expertise in Hadoop, Spark/Pyspark, Hive, YARN, Scala development, and data modeling. This position is based in Pune and Hyderabad.

Roles and Responsibility

Design and develop scalable data pipelines using Pyspark and Spark.
Collaborate with cross-functional teams to identify and prioritize project requirements.
Develop and maintain large-scale data systems and architectures.
Ensure data quality and integrity by implementing robust testing and validation procedures.
Participate in code reviews and contribute to improving overall code quality.
Troubleshoot and resolve complex technical issues efficiently.

Job Requirements

Strong proficiency in programming languages such as Python or Scala.
Experience with big data technologies including Hadoop, Spark/Pyspark, and Hive.
Knowledge of data modeling and operating systems such as Windows, Linux/Unix.
Familiarity with Agile Scrum methodologies and tools like Jira, Confluence, and GitHub.
Excellent problem-solving skills and attention to detail.
Ability to work collaboratively in a team environment and communicate effectively.
Full-time graduation.
Notice period: Immediate.

How to Apply

To apply, please send your resume to .

More Jobs at Krazy Mantra HR Solutions Pvt. Ltd

SAP GRC Professional

Mysuru

INR 7 - 10 Lacs

SAP FICO Lead

Krishnagiri

INR 7 - 10 Lacs

Mobile Penetration Testing Professional

Krishnagiri

INR 6 - 9 Lacs

SAP BPC Professional

Bengaluru

INR 4 - 8 Lacs

Assistant Manager Retail

ahmedabad

INR 4 - 6 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play

App Store

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Krazy Mantra HR Solutions Pvt. Ltd

Human Resources

Rajkot

RecommendedJobs for You

Pyspark Data Engineer

Krazy Mantra HR Solutions Pvt. Ltd

hyderabad, pune

Pyspark Data Engineer

Krazy Mantra HR Solutions Pvt. Ltd

hyderabad, pune

Pyspark Data Engineer

Bitwise Solutions

pune

Pyspark Data Engineer

Hyderabad, Telangana, India

Pyspark Data Engineer

Hyderabad, Telangana, India

Pyspark Data Engineer

Impetus Technologies

Bengaluru

Pyspark Data Engineer

Impetus Technologies

Bengaluru

Pyspark Data Engineer

Impetus Technologies

Bengaluru, Karnataka

Pyspark Data Engineer

Chennai, Tamil Nadu, India

Pyspark Data Engineer

Chennai