QA Engineer

Role Summary: 

We are looking for a detail-oriented and proactive QA Engineer to ensure the quality and reliability of our AI-powered applications. You will be responsible for validating complex agentic workflows, LLM integrations, and full-stack functionality across React.js front ends and AWS-based back-ends. This role requires a strong understanding of testing strategies for AI systems, APIs, and dynamic user interfaces. 

Key Responsibilities: 

• Design and execute test plans and test cases for AI-driven applications  

• Validate LLM outputs, RAG pipelines, and Knowledge Base integrations for correctness, consistency, and safety. 

• Perform functional, integration, regression, and exploratory testing across front-end nd back-end components. 

• Develop and maintain automated test suites for APIs and UI workflows. 

• Collaborate closely with AI engineers and product managers to ensure test coverage and early defect detection. 

• Monitor and report on test execution, bugs, and quality metrics using tools like JIRA or similar. 

• Contribute to continuous improvement of QA processes and tooling. 

Required Skills & Qualifications: 

• Strong experience in manual and automated testing of web applications and APIs. 

• Familiarity with React.js front-end testing using tools like Jest, React Testing Library, or similar tools. 

• Experience testing serverless back-ends using AWS Lambda and related services. 

• Understanding LLM behavior, prompt-response validation, and AI evaluation techniques. 

• Experience with Postman, REST API testing, and mocking/stubbing. 

• Proficiency in scripting languages like Python or JavaScript for test automation. 

• Familiarity with CI/CD pipelines and version control systems like Git. 

• Experience testing RAG pipelines, vector search, or embedding-based retrieval. 

• Understanding AI safety, bias testing, and hallucination detection. 

• Experience with load testing, performance testing, and security testing.