Test Lead - AI Agent Testing

Role & responsibilities

Experience: 5-8 YearsLocation: Bengaluru / HybridEmployment Type: Full-TimeAbout the RoleWe are seeking an experienced and highly motivated Senior AI QA Engineer to ensure the quality, reliability, performance, security, and accuracy of enterprise-grade AI applications.The ideal candidate will have strong experience testing modern web applications, APIs, cloud-native systems, and AI-powered solutions built using LLMs, Agentic AI frameworks, RAG architectures, Vector Databases, and Knowledge Graphs.You will work closely with AI Developers, Architects, Product Managers, and DevOps teams to establish quality engineering practices across the entire AI application lifecycle.Key ResponsibilitiesApplication TestingValidate React.js frontend applications.Test backend services built using Python and Node.js.Perform Functional, Integration, Regression, System, and User Acceptance Testing.Validate REST APIs and microservices.Ensure end-to-end business workflow validation.AI & Agent TestingTest AI agents built using LangGraph and LangChain.Validate agent orchestration workflows and decision-making paths.Verify tool calling, MCP integrations, and agent-to-agent communication.Build test scenarios for multi-agent systems.Validate prompt templates and prompt execution behavior.RAG & Search ValidationValidate document ingestion pipelines.Test chunking strategies and embedding generation.Verify vector database indexing and retrieval quality.Validate semantic search accuracy.Measure retrieval precision and relevance scores.Test grounding quality and hallucination prevention.Knowledge Graph TestingTest Neo4j graph ingestion pipelines.Validate node and relationship creation.Verify graph traversal accuracy.Test graph-based reasoning workflows.LLM TestingValidate GPT, Claude, Gemini, Llama, and other model integrations.Create AI evaluation datasets.Test response consistency and reliability.Validate hallucination rates.Measure factual c