QA Automation - Associate Manager

• Exposure to OpenAI, LangChain, LlamaIndex, or similar frameworks for GenAI systems.
• Experience testing prompt engineering workflows, RAG pipelines, or LLM inference APIs.
• Knowledge of regulatory compliance in financial software (e.g., AML, GDPR, FRB).
• ISTQB or other QA certifications are a plus
• Excellent communication skills

Key Responsibilities:

Design, develop, and execute manual and automated test cases for complex AI-powered applications. Validate the integration and behavior of GenAI and Agentic AI systems in software applications. Collaborate with AI/ML engineers to test model outputs, APIs, and prompt-response integrity.

Define and implement test strategies for data quality, performance, scalability, and explainability in AI solutions. Analyze system and business requirements, identifying gaps and inconsistencies early.

Work with product managers and financial SMEs to understand use cases in the financial services domain, especially related to compliance, transactions, and customer onboarding. Implement and maintain robust test automation frameworks using modern tools (e.g., PyTest, Playwright, Selenium, JMeter, etc.). Track, prioritize, and communicate bugs and quality metrics to stakeholders. Contribute to the development of QA best practices for GenAI/Agentic AI testing and ensure they are applied consistently across teams.