QA AI Automation

Key Responsibilities:

Comprehensive Test Strategy Development: Design, develop, document and execute comprehensive test plans and scenarios for AI chatbots, Agents and tools, focusing on the rigorous validation of output against established business requirements and expected AI behaviour.

Automated Test Scripting: Develop, maintain, document and enhance automated test scripts using programming languages such as Python, JavaScript, or Bash to ensure efficient and repeatable testing processes across various AI functionalities.

Defect Identification & Documentation: Proactively identify, document, and report inaccuracies, deviations, and potential issues within AI models and applications.

This includes providing clear, concise, and actionable bug reports with detailed steps to reproduce, expected results, and actual outcomes.

Cross-functional Collaboration: Collaborate closely with development, product management, and data science (AI) teams to understand requirements, validate fixes, and provide crucial feedback throughout the AI development lifecycle.

Continuous Improvement: Stay abreast of the latest advancements, best practices, and tools in AI testing, quality assurance, and test automation.

Continuously seek opportunities to optimize testing methodologies and improve overall product quality.

Performance & Scalability Testing: (Optional, consider if relevant) Conduct performance, load, and scalability testing on AI models to ensure they function optimally under various conditions and user loads.

Skills & Qualifications: Proven AI Testing Experience: Hands-on experience in testing AI-driven applications, conversational AI platforms, or chatbots, with a strong understanding of their unique testing challenges.

Proficient Scripting & Automation Skills: Demonstrated proficiency in developing and maintaining automated test scripts using Python, JavaScript, or Bash.

Analytical Acumen: Exceptional ability to interpret complex business and technical requirements and translate them into effective, actionable test scenarios and cases.

Testing Methodologies: Solid understanding of both manual and automated testing methodologies, including regression, functional, integration, and user acceptance testing.

Proactive & Independent: A self-starter with a proactive mindset, capable of identifying testing needs independently, prioritizing tasks effectively, and driving initiatives to completion.

Excellent Communication: Strong written and verbal communication skills.