Senior Python Developer (PySpark) 4+ years

Location:

Experience:

Notice Period:

Job Summary:

Python Developer with strong expertise in PySpark

Key Responsibilities:

• Design, develop, and maintain data pipelines using

  Python, PySpark, and Spark

  .
• Work with

  Hive, Unix shell scripting

  , and

  streaming solutions

  (Apache Kafka).
• Develop and optimize queries with

  strong SQL expertise

  .
• Debug and troubleshoot issues in code to ensure optimal performance.
• Work with

  Databricks

  and

  Azure cloud services

  to support data engineering solutions.
• Collaborate with cross-functional teams to ensure timely and high-quality deliverables.
• Apply analytical and problem-solving skills to resolve technical challenges effectively.

Required Skills:

• 3–4 years of professional experience in

  Python and PySpark

  development.
• Strong understanding of

  Spark

  framework and distributed data processing.
• Hands-on experience with

  Hive

  and

  Unix shell scripting

  .
• Strong knowledge of

  SQL

  (query writing, debugging, performance tuning).
• Experience with

  real-time data streaming (Apache Kafka)

  .
• Proficiency with

  Databricks

  and good knowledge of

  Azure cloud services

  .
• Quick learner with strong analytical and problem-solving skills.
• Excellent written and verbal communication skills.

Nice to Have:

• Experience with

  other cloud platforms (AWS/GCP)

  .
• Familiarity with advanced data engineering concepts.