Python PySpark Developer

Tekgence

4 - 9 years

15 - 30 Lacs

bengaluru

Posted:23 hours ago| Platform:

Apply

Skills Required

pyspark relational databases spark python development sql cloud big data

Work Mode

Work from Office

Job Type

Full Time

Job Description

Location: Bangalore

Job Summary

Python PySpark Developer

Key Responsibilities:

Data Pipeline Development: Build and maintain scalable ETL/ELT pipelines using PySpark.
Performance Optimization: Tune Spark applications, optimize queries, and improve processing efficiency.
Data Transformation: Clean, transform, and analyze large datasets.
Collaboration: Work with data engineers, scientists, and stakeholders to meet data needs.
Code Quality: Write clean, maintainable, and documented Python/PySpark code; perform code reviews.
Troubleshooting: Monitor, debug, and resolve data processing issues.
Participating in the entire software development lifecycle, often within an Agile methodology environment.

Required skills and qualifications:

Bachelors degree in computer science, Information technology or equivalent professional experience
Languages: Python, SQL.
Big Data: Apache Spark, PySpark (DataFrames, Spark SQL).
Databases: Relational Databases (MySQL, PostgreSQL).
Cloud: AWS, Azure, or GCP experience (Lambda, RDS, etc.) is a plus.
Tools: Git, Docker, Kubernetes, Airflow.
Concepts: Data modeling, data warehousing, distributed computing.
CoPilot

Years of experience needed 4 to 10 Years

More Jobs at Tekgence

Accounts Executive UK Shift (AP & AR)

Hyderabad

2 - 5 yrs

INR 1 - 4 Lacs

SAP Hiring (Long term contract)

Hyderabad, Bengaluru, Mumbai (All Areas)

6.0 - 11.0 yrs

INR 7 - 15 Lacs

Us It Recruiter

Hyderabad

2.0 - 4.0 yrs

INR 3 - 5 Lacs

Cloud Migration Specialist - AWS- AZURE

Chennai, Bengaluru

7.0 - 12.0 yrs

INR 15 - 25 Lacs

US IT Recruiter _ 2 To 4 Years Experience | Onsite Only

Noida

2.0 - 4.0 yrs

INR 3 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.