AI Quality Assurance Analyst

Job Description

Agnito Technologies is Hiring: AI Quality Assurance Analyst Location: Bhopal (Work From Office) Vacancy: 1 Experience: 4+ years in AI system validation and QA Package: No bar for the right candidate Role Overview: Agnito Technologies is seeking a detail-oriented AI Quality Assurance (QA) Analyst to ensure the accuracy, consistency, and safety of machine learning and AI model outputs. This role is critical in validating AI performance through systematic testing, identifying hallucinations, and ensuring reliable deployment in production systems. Key Responsibilities: Perform model evaluation to assess accuracy, reliability, and safety Conduct output consistency checks across various inputs and use cases Identify and report AI hallucinations and unintended responses Design and execute regression testing of ML outputs across model updates Collaborate with AI/ML engineers to refine models based on QA feedback Develop test plans and evaluation frameworks tailored to specific use cases Required Skills & Experience: 4+ years of experience in AI/ML system testing and validation Familiarity with LLMs, classification models, NLP outputs, and model pipelines Strong skills in automated and manual testing frameworks for ML workflows Experience designing QA processes for AI systems in production Attention to detail with a strong commitment to AI model quality and compliance Job Type: Full-time Schedule: Day shift Work Location: In person Speak with the employer +91 9343131335