Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in hyderabad
>
Algoleap Technologies
>
SpySpark Developer

SpySpark Developer

Algoleap Technologies

3 - 6 years

5 - 8 Lacs

hyderabad

Posted:None| Platform:

Apply

Skills Required

performance tuning spark devops cloud data governance data processing deployment aws quality compliance analytics

Work Mode

Work from Office

Job Type

Full Time

Job Description

Job_Description":"

Job Summary

We are looking for a Senior PySpark Developer with 3 to 6years of experience in building and optimizing data pipelines using PySpark onDatabricks, within AWS cloud environments. This role focuses on themodernization of legacy domains, involving integration with systems like Kafkaand collaboration across cross-functional teams.

Key yesponsibilities

- Develop and optimize scalable PySparkapplications on Databricks.

- Work with AWS services (S3, EMy, Lambda, Dlue)for cloud-native data processing.

- Integrate streaming and batch data sources,especially using Kafka.

- Tune Spark jobs for performance, memory, andcompute efficiency.

- Collaborate with DevOps, product, and analyticsteams on delivery and deployment.

- Ensure data governance, lineage, and qualitycompliance across all pipelines.

yequired Skills

- 36 years of hands-on development in PySpark.

- Experience with Databricks and performancetuning using Spark UI.

- Strong understanding of AWS services, Kafka, anddistributed data processing.

- Proficient in partitioning, caching, joinoptimization, and resource configuration.

- Familiarity with data formats like Parquet,Avro, and OyC.

- Exposure to orchestration tools (Airflow,Databricks Workflows).

- Scala experience is a strong plus.

","

More Jobs at Algoleap Technologies

Full Stack Developer

Hyderabad

5 - 8 yrs

INR 18 - 20 Lacs

Data Engineer

Hyderabad

7 - 12 yrs

INR 22 - 25 Lacs

Supply Chain Intelligence - Consultant / Sr. Consultant

Hyderabad

2 - 5 yrs

INR 4 - 7 Lacs

DevOps Engineer

Hyderabad

8 - 13 yrs

INR 25 - 30 Lacs

Sr Data Engineer

Hyderabad

6.0 - 11.0 yrs

INR 18 - 20 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.