PySpark Data Engineer

2 - 5 years

Hyderabad Chennai Bengaluru

Posted:1 week ago

Apply

Job Description

Role & Responsibilities

  • Design and develop scalable data pipelines using PySpark.
  • Build ETL workflows and data transformation solutions.
  • Process large-scale structured and unstructured datasets.
  • Develop and optimize Spark applications for performance.
  • Work with SQL and Spark SQL for data analysis and processing.
  • Ensure data quality, scalability, and reliability.
  • Troubleshoot and resolve data pipeline issues.
  • Collaborate with business and technical teams.

Preferred Candidate Profile

  • 2-5 years of experience in Data Engineering.
  • Strong hands-on experience with PySpark and Apache Spark.
  • Strong Python programming skills.
  • Good SQL knowledge.
  • Experience in ETL and Big Data technologies.
  • Exposure to Databricks, Hadoop, or Hive is preferred.
  • Strong analytical and problem-solving abilities.

Skills Required

Pyspark Data Engineering Apache Spark Python SQL Hive Hadoop Big Data

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Hybrid

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Infosys logo
Infosys

IT Services and IT Consulting

Bangalore Karnataka

RecommendedJobs for You

Hyderabad, Chennai, Bengaluru

Hyderabad, Chennai, Mumbai

Hyderabad, Chennai, Bengaluru

Hyderabad, Chennai, Mumbai