We are seeking a highly experienced
Senior Quality Assurance Lead
to drive the quality strategy, validation framework, and end-to-end testing of conversational AI solutions built on AWS Lex and Google Dialogflow (CX/ES). The ideal candidate will oversee the testing lifecycle for steering bots, skill bots, and multi-bot orchestration while ensuring accuracy, reliability, and high-quality conversational experiences across voice and chat channels. This role requires strong technical depth in bot testing, the ability to define QA best practices, and proven experience collaborating with cross-functional teams including solution architects, developers, and business stakeholders.
Responsibilities:
- Lead the planning, design, and execution of test strategies, test plans, and test cases for AWS Lex and Google Dialogflow bots.
- Oversee functional, regression, integration, and end-to-end testing across voice, chat, and web channels.
- Validate conversation flows, NLU accuracy, intent mapping, slot filling, journey logic, and middleware/API integrations.
- Review requirements, conversation designs, and user stories to ensure clarity, completeness, and testability.
- Manage testing for multi-bot orchestration setups between steering and skill bots to ensure seamless user experiences.
- Supervise and validate testing of voice interactions via platforms such as Amazon Connect, Google CCAI, or Genesys Cloud.
- Drive defect identification, root cause analysis, reporting, and quality metrics using industry-standard QA tools.
- Guide automation strategy and contribute to building automation scripts/frameworks where applicable.
- Lead UAT cycles, prepare quality summary reports, and ensure delivery of bots that meet accuracy, latency, and experience benchmarks.
- Mentor junior QA engineers and promote QA best practices, reusable patterns, and testing standards.
-
8+ years of hands-on QA experience
, including 3+ years leading QA efforts
for conversational AI, IVR, or bot-based solutions. - Strong expertise in IVR testing platforms such as
CYARA Velocity, CYARA Virtual Agent, and CYARA Cruncher
. - 2+ years of hands-on testing experience with
AWS Lex (V1/V2)
and Google Dialogflow CX/ES
. - Good understanding of conversation design, NLU/NLP concepts, intent handling, and model testing.
- Experience validating integrations with AWS Lambda, API Gateway, Google Cloud Functions, or similar middleware components.
- Strong skills in API testing (Postman, REST Assured) and automation frameworks (Selenium, PyTest, or equivalent).
- Solid understanding of bot architecture, routing logic, and orchestration between multiple bots.
- Excellent knowledge of QA methodologies, defect management practices, and detailed test documentation.
- Experience working in Agile teams with tools like Jira and Confluence.
- Strong communication, analytical thinking, leadership, and problem-solving abilities.
-
Nice to Have:
- Exposure to conversational AI automation frameworks such as Botium, TestMyBot, or Voiceflow QA tools.
- Familiarity with Google CCAI, Amazon Connect, or Genesys Cloud integrations.
- Experience performing load, performance, or stress testing for voice/chat bots.
- Understanding of CI/CD pipelines, CloudWatch, Dialogflow Analytics, or bot monitoring tools.
- Basic scripting knowledge in Python or JavaScript for automation support.
We offer:
-
Culture of Relentless Performance
: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth. -
Competitive Pay and Benefits
: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program. -
Work From Anywhere Culture
: make the most of the flexibility that comes with remote work. -
Growth Mindset
: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities. -
Global Impact
: collaborate on impactful projects for top global clients and shape the future of industries. -
Welcoming Multicultural Environment
: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events. -
Social Sustainability Values
: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.
Job for Automation