
Quality Assurance Engineer – Conversational AI & Voice Testing
Posted 23 hours ago

Posted 23 hours ago
This is a fully remote position, open to applicants in Canada.
• Design, develop, and implement functional, regression, integration, and end-to-end test scenarios for conversational AI, voice, and customer interaction solutions.
• Validate conversational flows, intent recognition, entities, utterances, response accuracy, escalation paths, and exception handling processes.
• Create and maintain automated test suites to enhance testing coverage, efficiency, and release quality.
• Test voice and telephony interactions, which include speech recognition, touch-tone inputs, call routing, transfers, and customer journey workflows.
• Validate integrations between conversational platforms, backend systems, APIs, and third-party services.
• Conduct system-level and user journey testing across various channels.
• Identify, document, track, and verify defects while collaborating with developers, solution architects, business analysts, and product teams.
• Develop test plans, test cases, execution reports, and quality metrics.
• Participate in requirements reviews and provide quality-focused feedback early in the development lifecycle.
• Ensure applications meet quality standards, functional requirements, performance expectations, and customer experience objectives.
• Contribute to test process enhancements, automation strategies, and ongoing quality initiatives.
• 5+ years of experience in Quality Assurance, with practical experience in testing conversational AI, IVR, voice applications, or customer engagement platforms.
• 3+ years of hands-on experience using Cyara Cruncher, Cyara Velocity, and Cyara Virtual Agent for test design, execution, automation, and reporting.
• Experience in testing conversational AI solutions utilizing AWS Lex and/or Google Dialogflow CX/ES, covering intent recognition, conversation flows, and response validation.
• Strong knowledge of functional, regression, integration, system, and end-to-end testing methodologies.
• Deep understanding of conversational AI concepts, including NLU, intents, entities, utterances, context management, fallback handling, and escalation workflows.
• Hands-on experience in validating IVR and voice interactions, including speech recognition, DTMF inputs, call routing, transfers, and call termination scenarios.
• Experience in testing APIs, backend integrations, data exchanges, and contact center workflows across enterprise applications.
• Extensive experience in test planning, test case design, defect management, execution reporting, and quality assurance best practices.
• Excellent analytical, troubleshooting, communication, stakeholder collaboration, and documentation skills.
• Experience with performance, load, stress, and scalability testing of conversational AI and voice applications.
• Familiarity with SIP, telephony protocols, speech recognition technologies, DTMF, and call-routing concepts.
• Experience with test automation frameworks, API testing tools, and CI/CD-enabled QA practices.
• Exposure to Amazon Connect, Genesys Cloud, or other contact center platforms.
• Knowledge of conversational analytics, customer experience monitoring, and AI-driven customer engagement solutions.
• Health insurance.
• Language courses.
• Relocation program.
• Professional development opportunities.
• Certification programs.
• Mentorship and talent investment programs.
• Internal mobility opportunities.
• Internship opportunities.
• Flexible remote work.
• Regular team-building company social events.
• Inclusive and supportive work environment.
• Social sustainability initiatives focused on IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.
Fortrea
BrightSpring Health Services
Alpaca Health
Alpaca Health
Get handpicked remote jobs straight to your inbox weekly.