Automation Test Engineer- GenAI

Role: Automation Test Engineer- GenAI

Location: PAN India

Experience: 7+ years

Immediate Joiners Only

Role summary:

Key skills / responsibilities:

Hands-on testing of GenAI/LLM applications, AI agents, conversational AI/chatbots and RAG-based solutions.

Validate response accuracy, relevance, grounding, hallucinations, consistency, guardrails and fallback/error scenarios.

Test prompts and responses across positive, negative, boundary and adversarial scenarios.

Perform functional, API, integration, end-to-end and regression testing.

API testing using Postman/Newman, REST Assured, pytest or equivalent.

UI/API automation using Playwright, Selenium, Cypress or equivalent.

Validate data and backend integrations using SQL and API/database validation.

Build and maintain automated regression suites integrated with CI/CD pipelines.

Azure/OpenAI GenAI application experience preferred.

Work flexibility: Ability to work in a globally distributed India-US model, provide regular working-hour overlap with the US team for collaboration, defect triage and testing, and support critical releases when required.