Senior Quality Assurance (QA) Engineer - AI

Job Overview:

We are seeking a detail-oriented and experienced Quality Assurance (QA) Engineer to join our team. You will be responsible for ensuring the performance, accuracy, and reliability of our AI conversational systems, including natural language processing (NLP), speech-to-text (STT), text-to-speech (TTS), and AI dialogue management. The ideal candidate should have strong analytical skills, a deep understanding of AI testing methodologies, and experience working with AI-driven conversational interfaces.

Key Responsibilities:

• Develop, and execute comprehensive test plans and test cases for AI conversational systems, ensuring all functional and non-functional requirements are met.
• Conduct end-to-end testing of speech recognition (STT), natural language understanding (NLU), and response generation (NLG) within the AI platform.
• Perform manual and automated testing of conversational flows, including edge cases, error handling, and multi-turn dialogues.
• Validate the system s ability to understand and process various user intents, entities, and languages.
• Test integrations between different components of the AI system, including third-party APIs, speech interfaces, and backend data systems.
• Ensure the quality and accuracy of voice output (TTS) and conduct thorough testing of speech quality across different platforms and devices.
• Identify and document bugs, performance issues, and user experience problems, and work closely with developers and AI engineers to resolve them.
• Monitor system performance and behavior under different conditions, including large-scale interactions and stress testing.
• Conduct regression testing after each update to ensure previous features remain functional and efficient.
• Collaborate with cross-functional teams (AI/ML engineers, product managers, and UI/UX designers) to define quality benchmarks and maintain continuous improvement in testing processes.

Required Skills and Qualifications:

• 5-8 years experience and a Bachelor s degree in Computer Science, Engineering, or a related field.
• Proven experience as a QA Engineer, preferably with exposure to AI/ML-based systems or conversational AI platforms.
• Familiarity with natural language processing (NLP), machine learning models, and speech technologies such as STT, TTS, and dialogue systems.
• Test Automation : Proficiency in Selenium, Appium, Cypress, Playwright, or Robot Framework for UI automation; PyTest, JUnit, TestNG for API testing.
• API Testing: Hands-on experience with Postman, RestAssured, or SoapUI to test AI APIs, ensuring smooth integration.
• Excellent problem-solving skills with a focus on quality and attention to detail.
• Experience in agile software development methodologies.
• Strong communication skills and the ability to work collaboratively in a team-oriented environment.

Preferred Qualifications:

• Experience working with conversational AI platforms
• Familiarity with testing frameworks for AI models
• Knowledge of multilingual and multi-accent conversational testing.
• Understanding of user experience (UX) testing for voice interfaces.
• Experience in performance and load testing for AI systems.