AI Manual Tester

Company:

Website:

Business Type:

Company Type:

Business Model:

Funding Stage:

Industry:

Salary Range:

ABOUT INCRUITER

AI-powered Stack Interview Intelligence Platform

InCruiter

EXL, Welspun, Dentsu, Manhattan Associates, ArcelorMittal, Telstra, Siemens,

EXCITED ABOUT YOUR TASKS?

• Test Planning & Strategy
• Analyse product requirements, AI model flows, inputs/outputs, and edge cases.
• Create detailed test plans, scenarios, and cases covering functional + AI-specific behaviour.
• Proactively identify risky areas, logical gaps, and unpredictable model responses.
• Functional, Regression & AI Behaviour Testing
• Perform end-to-end testing of SaaS modules and AI-powered features.
• Validate AI model behaviour for accuracy, consistency, and stability.
• Test AI outputs across varied datasets, user inputs, and conditions.
• Conduct regression testing on every release cycle to ensure production reliability.
• Defect Analysis & Reporting
• Log defects with clear reproduction steps, data inputs, expected vs actual model behaviour.
• Collaborate closely with the ML/AI engineering and development teams to verify behaviour anomalies.
• Prioritize issues based on user impact and release timelines.
• Documentation & Release Quality
• Maintain AI-specific test cases, prediction logs, edge-case matrices, and QA documentation.
• Create and maintain release checklists ensuring zero-high severity bugs in production.
• Continuously improve test coverage for both SaaS and AI layers.
• Collaboration & Ownership
• Participate actively in requirement discussions, sprint planning, design reviews, and model behaviour sessions.
• Communicate model inconsistencies or biases early and suggest corrective actions.
• Take ownership of overall product quality and user experience.
  

WHAT WILL YOU NEED TO SUCCEED?

Technical Skills

• 4–5 years of hands-on experience in Manual Testing for SaaS platforms.
• Mandatory: Strong understanding of AI/ML model behaviour — inputs, outputs, accuracy, failure modes, edge cases.
• Experience validating AI outputs for correctness, patterns, bias, drift, and consistency.
• Strong logical reasoning, analytical mindset, and problem-solving ability.
• Familiarity with functional, regression, exploratory, and scenario-based testing.
• Basic API testing skills (Postman or similar).
• Good understanding of SDLC, STLC, bug lifecycle, Agile methodology.
• Experience with Jira, TestRail, Confluence or equivalent tools.
• Knowledge of model accuracy metrics (precision, recall, F1 score).
• Experience testing LLM-based features, chat flows, or recommendation systems.
• SQL basics for backend data validation.