
Quality Assurance Engineer – Conversational AI & Voice Testing
Posted 23 hours ago

Posted 23 hours ago
This is a fully remote position, open to applicants in Canada.
• Design, develop, and implement functional, regression, integration, and end-to-end testing scenarios for conversational AI, voice, and customer interaction solutions.
• Validate conversational workflows, intent recognition, entities, utterances, response accuracy, escalation paths, and exception handling processes.
• Create and maintain automated testing suites to enhance testing coverage, efficiency, and release quality.
• Test voice and telephony interactions, including speech recognition, touch-tone inputs, call routing, transfers, and customer journey workflows.
• Confirm integrations between conversational platforms, backend systems, APIs, and third-party services.
• Conduct system-level and user journey testing across various channels.
• Identify, document, track, and verify defects.
• Collaborate with developers, solution architects, business analysts, and product teams.
• Develop test plans, test cases, execution reports, and quality metrics.
• Engage in requirements reviews and provide quality-oriented feedback.
• Ensure applications meet quality standards, functional requirements, performance expectations, and customer experience objectives.
• Contribute to enhancements in testing processes, automation strategies, and continuous quality initiatives.
• Over 5 years of experience in Quality Assurance.
• Practical experience testing conversational AI, IVR, voice applications, or customer engagement platforms.
• More than 3 years of hands-on experience with Cyara Cruncher, Cyara Velocity, and Cyara Virtual Agent.
• Experience in testing conversational AI solutions utilizing AWS Lex and/or Google Dialogflow CX / ES.
• Strong understanding of functional, regression, integration, system, and end-to-end testing methodologies.
• In-depth knowledge of conversational AI concepts, including NLU, intents, entities, utterances, context management, fallback handling, and escalation workflows.
• Practical experience validating IVR and voice interactions, including speech recognition, DTMF inputs, call routing, transfers, and call termination scenarios.
• Experience testing APIs, backend integrations, data exchanges, and contact center workflows across enterprise applications.
• Extensive experience in test planning, test case design, defect management, execution reporting, and quality assurance best practices.
• Excellent analytical, troubleshooting, communication, stakeholder collaboration, and documentation skills.
• Competitive Pay and Benefits: comprehensive compensation and benefits package.
• Health insurance.
• Language courses.
• Relocation program.
• Remote work flexibility.
• Professional development opportunities.
• Certification programs.
• Mentorship and talent investment programs.
• Internal mobility opportunities.
• Internship opportunities.
• Inclusive and supportive work environment.
• Regular team-building company social events.
Fortrea
BrightSpring Health Services
Alpaca Health
Alpaca Health
Get handpicked remote jobs straight to your inbox weekly.