AI Tester

As a detail-oriented Generative AI Tester with 3+ years / 6+ years of experience, your primary responsibility will be to validate the quality, reliability, and ethical outputs of AI systems powered by large language models (LLMs). In this role, you will focus on testing prompt responses, evaluating edge cases, and ensuring that AI outputs align with business and compliance standards. Your key responsibilities will include designing and executing test cases for Gen AI features and conversational workflows, validating the outputs of LLMs for accuracy, relevance, coherence, and safety, conducting prompt testing, fine-tuning evaluation, and edge-case scenario validation. You will also collaborate with AI engineers, product managers, and QA teams to improve test coverage and feedback loops, document defects, issues, and improvement areas using tools like JIRA or similar, and evaluate AI systems against ethical and fairness benchmarks. To be successful in this role, you should have at least 2+ years of experience in QA/testing, with exposure to AI/ML or NLP systems. It is essential to be familiar with LLMs such as GPT, Claude, or open-source alternatives, possess strong analytical and critical thinking skills for non-deterministic system testing, have experience with test management tools and basic scripting (Python preferred), and a good understanding of prompt engineering and model evaluation principles. Preferred qualifications include experience in testing conversational AI, chatbots, or virtual assistants, an understanding of responsible AI practices including bias and hallucination detection, and exposure to RAG (Retrieval-Augmented Generation) pipelines and vector databases.,