Jobs
Interviews
Infosys logo

PySpark Developer

Bengaluru east

Posted:4 days ago

Apply

Job Description

Strong experience in PySpark. Good programming knowledge of Python. Hands-on experience with SQL. Understanding of ETL/ELT concepts and data warehousing. Experience working with large datasets and distributed processing. Knowledge of Spark SQL, DataFrames, and Spark transformations. Familiarity with Linux/Unix environment.
Design, develop, and maintain data pipelines using PySpark. Develop ETL/ELT processes for ingesting, transforming, and loading large volumes of data. Write optimized PySpark code for data processing and transformation. Work with structured and semi-structured data from multiple sources. Develop and optimize SQL queries for data extraction and validation. Troubleshoot data quality and performance issues. Collaborate with Data Engineers, Analysts, and Business teams to understand requirements. Participate in code reviews and follow data engineering best practices. Monitor and support production data pipelines. Exposure to cloud platforms such as AWS, Azure, or GCP. Knowledge of Databricks. Experience with workflow orchestration tools such as Airflow. Understanding of CI/CD concepts.

Skills Required

Pyspark Python SQL ETL Data Warehousing Spark Linux Unix Data Processing SQL Queries Data Extraction Data Quality

Learn the skills this job asks for

See your skill gap for Software Developer →

Free courses, interview questions and practice for each skill.

Job Type

Full Time

More Jobs at Infosys

Devops Engineer

Bengaluru

6 - 9 yrs
|

Salary: Not disclosed

Senior Golang Engineer

Bengaluru

5 - 9 yrs
|

Salary: Not disclosed

Java Developer

Pune, Chennai, Bengaluru

2 - 3 yrs
|

Salary: Not disclosed

Software Developer - Dotnet

Kolkata, Pune, Bengaluru

5 - 8 yrs
|

Salary: Not disclosed

Java Back End Developer

Hyderabad, Pune, Bengaluru

1 - 2 yrs
|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Infosys logo
Infosys

IT Services and IT Consulting

Bangalore Karnataka

RecommendedJobs for You

Infosys logo

PySpark Developer

Infosys

Bengaluru east

Infosys logo

PySpark Developer

Infosys

Bengaluru east