We are seeking a detail-oriented and experienced Quality Assurance (QA) Engineer to join our team. You will be responsible for ensuring the performance, accuracy, and reliability of our AI conversational systems, including natural language processing (NLP), speech-to-text (STT), text-to-speech (TTS), and AI dialogue management. The ideal candidate should have strong analytical skills, a deep understanding of AI testing methodologies, and experience working with AI-driven conversational interfaces.

Key Responsibilities:

D evelop, and execute comprehensive test plans and test cases for AI conversational systems, ensuring all functional and non-functional requirements are met.

Conduct end-to-end testing of speech recognition (STT), natural language understanding (NLU), and response generation (NLG) within the AI platform.

Perform manual and automated testing of conversational flows, including edge cases, error handling, and multi-turn dialogues.

Validate the system s ability to understand and process various user intents, entities, and languages.

Test integrations between different components of the AI system, including third-party APIs, speech interfaces, and backend data systems.

Ensure the quality and accuracy of voice output (TTS) and conduct thorough testing of speech quality across different platforms and devices.

Identify and document bugs, performance issues, and user experience problems, and work closely with developers and AI engineers to resolve them.

Monitor system performance and behavior under different conditions, including large-scale interactions and stress testing.

Conduct regression testing after each update to ensure previous features remain functional and efficient.

Collaborate with cross-functional teams (AI/ML engineers, product managers, and UI/UX designers) to define quality benchmarks and maintain continuous improvement in testing processes.

Required Skills and Qualifications:

Bachelors degree in Computer Science , Engineering, or a related field.

Proven experience as a QA Engineer, preferably with exposure to AI/ML-based systems or conversational AI platforms.

Familiarity with natural language processing (NLP), machine learning models, and speech technologies such as STT, TTS, and dialogue systems.

Proficient in test automation tools and frameworks for both functional and non-functional testing (eg, Selenium, JUnit, etc).

Strong understanding of API testing and experience using API testing tools like Postman.

Excellent problem-solving skills with a focus on quality and attention to detail.

Experience in agile software development methodologies.

Strong communication skills and the ability to work collaboratively in a team-oriented environment.

Preferred Qualifications:

Experience working with conversational AI platforms

Familiarity with testing frameworks for AI models

Knowledge of multilingual and multi-accent conversational testing.

Understanding of user experience (UX) testing for voice interfaces.

Experience in performance and load testing for AI systems.

More Jobs at Sumtotal Systems

Software Quality Engineer II

Hyderabad

3.0 - 8.0 yrs

INR 13 - 17 Lacs

IT Engineer, Agentic AI (Microsoft Copilot Studio & Azure AI Studio

Hyderabad

8.0 - 8.0 yrs

INR 10 - 11 Lacs

Sr Analyst, Instructional Designer (Content Strategist) - Programming

Hyderabad

2.0 - 8.0 yrs

INR 12 - 16 Lacs

Principal Instructional Designer (Content Strategist)-AI/ML

Hyderabad

5.0 - 10.0 yrs

INR 22 - 30 Lacs

Principal AI/Machine Learning Engineer

Hyderabad

8.0 - 13.0 yrs

INR 5 - 12 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Stress Testing Interview Now

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

Sumtotal Systems

12 Jobs

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Prin, QA Engineer