Lead QA Engineer

Responsibilities

• Build and maintain automated test scripts for REST/API-based data access services
• Test Spark job outputs for correct transformations, aggregations, and schema
• Validate data pipelines end-to-end for completeness, accuracy, and consistency
• Write SQL queries to verify data in databases/data lakes against expected results
• Work with data engineers/PMs to define test scope from pipeline requirements
• Log and track defects (e.g., JIRA) and support root cause analysis
• Debug and analyze logs to identify failure root cause and enable resolution
• Integrate automated tests into CI/CD pipelines
• Maintain deployment pipelines and workloads for QA environments
  

Qualifications

• 7-9 years of QA/automation experience
• Working knowledge of Python or Java for test scripting
• Exposure to REST API testing (Postman, RestAssured, or requests)
• Basic understanding of big data concepts and Apache Spark (DataFrames, jobs, transformations)
• Good SQL skills for data validation
• Exposure to CI/CD tools (Jenkins/GitLab CI) and Git
• Strong analytical skills and good communication for cross-functional collaboration