Python Pyspark Developer

5 - 9 years

5.0 - 14.0 Lacs P.A.

Chennai, Bengaluru, Kolkata

Posted:2 months ago| Platform: Naukri logo

Apply Now

Skills Required

PysparkHdfsPythonHiveSparkPythonsparkSQL

Work Mode

Work from Office

Job Type

Full Time

Job Description

Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data processing pipelines using PySpark on AWS EMR. Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions. Develop complex SQL queries to extract insights from HIVE tables and perform analysis. Ensure efficient data processing by optimizing Spark jobs through tuning parameters such as spark.executor.cores, memory, etc. Desired Candidate Profile 5-9 years of experience in working with PySpark, Python programming language, Spark (Scala), SQL, Hive+. Strong understanding of big data technologies like Hadoop Distributed File System (HDFS) and ability to work with large datasets.

Advance Career Solutions
Advance Career Solutions

Business Consulting and Services

Los Angeles

2-10 Employees

35 Jobs

    Key People

  • John Doe

    CEO
  • Jane Smith

    COO

RecommendedJobs for You

Chennai, Tamil Nadu, India

Bengaluru East, Karnataka, India