Python - Senior Engineer

• Minimum 5+ years of experience in a QE/ Agile environment with a focus on technical, automated validations leveraging variety of tools/ technologies/ frameworks.
• Lead the design and development of end-to-end ETL/ELT data pipelines using PySpark to ingest, transform, and process massive datasets from various sources.
• Optimize and fine-tune complex PySpark jobs to improve performance, reduce execution time, and minimize computational costs.
• Write clean, modular, and well-documented code following software development best practices.
• Extensive experience with at least one major cloud platform (AWS, Azure, or GCP) for building data solutions.
• Work closely with tech leads, data scientist, business analysts, and product managers to understand data requirements and translate them into technical solutions.
• Excellent analytical and problem-solving skills, with the ability to independently debug and resolve complex data-related issues.
• Undergraduate degree in Technology
• Very good Python-coding skills, with focus on Spark/PySpark
• Strong QA or Development background with focus on delivering excellent, well-tested, quality software into production, taking on the role of gatekeeper to production.
• Must have implemented and be very familiar with CI/CD pipelines.
• Strong communicator with good organizational and time management capabilities, able to establish good working relationships across teams.
• Deadline-driven and results-oriented; able to meet consistently high-quality standards while handling a variety of tasks and deadlines simultaneously.

Nice-to-have:

• Post Graduate degree in Data Science.
• Experience working with Models
• Experience developing or testing AI Frameworks.
• Cloud-related experience.