Senior Quality Analyst (Automation & Manual)

Strong knowledge of Python. Configure and test AI/ML product/system. Lead the quality assurance strategy and establish automation frameworks from scratch. Manage and mentor junior QA engineers and guide them in test automation and AI system validation. Own functional and non-functional testing across complex distributed systems. Own API, integration, acceptance, system, and end-to-end (E2E) testing. Lead test planning, test case design, and execution for web, API, and AI-based systems. Design and maintain regression test suites and ensure full coverage. Collaborate with Full Stack Developers, Data Scientists, and AI Engineers to define test strategies for LLM-based features. Own testing of AI-specific behaviors including: o Hallucination and factual accuracy o Consistency in prompt-response pairs o Retrieval-Augmented Generation (RAG) flows Collaborate with developers, product owners, and other QA engineers in Agile teams. Must-Have Skills Deep experience in Functional Testing: o Advanced REST API Testing (Postman, REST Assured, etc) o Integration, Acceptance, E2E, Smoke, Sanity, System Testing Strong foundation in Non-Functional Testing: o Performance and Load Testing o Stress and Security Testing Proficiency in Testing Methods: o Black-box, White-box, Grey-box Testing Regression Testing lifecycle ownership Expertise in automation frameworks (eg, Selenium, Playwright, Cypress, TestNG) Strong scripting/coding skills in Python (preferable) / Java / JavaScript Familiarity with containerized environments (Docker, Kubernetes) Good-to-Have (AI Testing Focus) Exposure to testing AI/ML products/systems. Experience of integrating tests into CI/CD pipelines (GitHub Actions, GitLab, Azure DevOps etc). Hands-on experience with AI testing tools or custom frameworks. Familiarity with evaluating LLM (large language model) outputs. Experience of validating RAG-based architecture. Understanding of hallucination detection metrics and prompt tuning. Exposure to safety audits for AI applications. Collaboration experience with Full Stack, Data Science, Data Engineering DevOps teams. Qualifications bachelors or masters in computer science, Engineering, or related field. Certifications in testing or security are a plus (eg, ISTQB, OWASP).