Python developer with Spark

Role Overview: You will be responsible for developing and maintaining scalable data pipelines utilizing Python and PySpark. Your role involves collaborating closely with data engineers and data scientists to comprehend and meet data processing requirements efficiently. Key Responsibilities: - Develop and maintain scalable data pipelines using Python and PySpark - Collaborate with data engineers and data scientists to meet data processing requirements - Optimize and resolve issues in existing PySpark applications to enhance performance - Write clean, efficient, and well-documented code following industry best practices - Participate in design and code reviews to ensure quality and consistency - Develop and execute ETL processes for data extraction, transformation, and loading purposes Qualifications Required: - Skilled developer with experience in Python and PySpark - Strong understanding of data processing requirements - Ability to optimize and enhance performance of PySpark applications - Proficiency in writing clean and well-documented code - Experience in developing and executing ETL processes (Note: No additional details of the company were provided in the job description),