Pyspark Developer

Job Description

Job Title: Senior PySpark Developer Location: Hyderabad, India Experience: Minimum 7.5 years Job Summary: We are seeking a highly experienced and skilled Senior PySpark Developer to join our dynamic data engineering team at our Hyderabad office. The ideal candidate will have a strong background in building scalable data pipelines, a deep understanding of distributed computing principles, and hands-on expertise in big data technologies including Hadoop and Spark. Key Responsibilities: Design, develop, and maintain efficient and scalable data pipelines using PySpark. Optimize data workflows for performance, reliability, and scalability. Work with large volumes of structured and unstructured data in a distributed computing environment. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements. Troubleshoot and resolve performance, data quality, and processing issues. Implement best practices in code development, testing, and deployment processes. Document system designs, architectures, and processes. Must-Have Skills: Proficiency in PySpark with at least 7.5 years of hands-on experience. Strong understanding of distributed computing principles . Solid experience in designing and implementing scalable and efficient data pipelines . Expert-level knowledge of the Python programming language . Practical knowledge of big data technologies including Hadoop and Spark . Good-to-Have Skills: Experience with Apache Kafka or other real-time streaming platforms. Qualifications: Bachelor’s or master’s degree in computer science, Engineering, or related field. Proven experience working in large-scale data environments. Strong problem-solving and analytical skills. Excellent communication and collaboration abilities. Show more Show less