Home
Jobs

Assistant Manager - PySpark

1 - 4 years

3 - 6 Lacs

Posted:3 weeks ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

KPMG India is looking for Assistant Manager - PySpark to join our dynamic team and embark on a rewarding career journey. Apache Spark Fundamentals: You have a solid understanding of the Apache Spark architecture, its components like Spark Core, Spark SQL, Spark Streaming, MLlib, and Spark GraphX. Python Programming: You are proficient in Python programming language as PySpark heavily relies on Python APIs for data manipulation, analysis, and processing. Data Manipulation and Analysis: You are experienced in performing data manipulation tasks such as filtering, transforming, aggregating, and joining large datasets using PySpark DataFrame API or RDDs (Resilient Distributed Datasets). Spark SQL: You can write SQL queries using Spark SQL for querying structured data and performing analytics operations on DataFrames and tables. Data Processing Pipelines: You are capable of designing and building end-to-end data processing pipelines using PySpark that can handle various stages of data ingestion, cleaning, transformation, and analysis. Performance Optimization: You have knowledge of techniques for optimizing PySpark jobs and improving the performance of Spark applications, including partitioning, caching, and tuning the execution settings. Integration with External Systems: You can integrate PySpark with various data sources and file formats such as HDFS, S3, Hive, Parquet, Avro, JSON, CSV, etc.

Mock Interview

Practice Video Interview with JobPe AI

Start Networking Interview Now
KPMG India
KPMG India

Professional Services

Pune

16,000+ Employees

590 Jobs

    Key People

  • Ram Kumar

    Chief Executive Officer
  • Sreedhar S

    Partner - Audit

RecommendedJobs for You