Quality Assurance Engineer – Conversational AI, Voice Testing

This is a fully remote position, open to applicants in United States, +1 more country.

📋 Description

• Design, develop, and implement functional, regression, integration, and end-to-end test scenarios for conversational AI, voice, and customer interaction solutions.

• Assess conversational flows, intent recognition, entities, utterances, response accuracy, escalation paths, and exception handling.

• Create and sustain automated test suites to enhance testing coverage, efficiency, and release quality.

• Evaluate voice and telephony interactions, including speech recognition, touch-tone inputs, call routing, transfers, and customer journey workflows.

• Confirm integrations between conversational platforms, backend systems, APIs, and third-party services.

• Conduct system-level and user journey testing across various channels.

• Identify, document, track, and verify defects.

• Collaborate with developers, solution architects, business analysts, and product teams.

• Develop test plans, test cases, execution reports, and quality metrics.

• Participate in requirements reviews and provide feedback focused on quality.

• Ensure applications comply with quality standards, functional requirements, performance expectations, and customer experience objectives.

• Contribute to enhancements in testing processes, automation strategies, and continuous quality initiatives.

⛳️ Requirements

• Over 5 years of experience in Quality Assurance, particularly with hands-on testing of conversational AI, IVR, voice applications, or customer engagement platforms.

• More than 3 years of practical experience with Cyara Cruncher, Cyara Velocity, and Cyara Virtual Agent for test design, execution, automation, and reporting.

• Experience in testing conversational AI solutions using AWS Lex and/or Google Dialogflow CX/ES, focusing on intent recognition, conversation flows, and response validation.

• Strong understanding of functional, regression, integration, system, and end-to-end testing methodologies.

• In-depth knowledge of conversational AI concepts, including NLU, intents, entities, utterances, context management, fallback handling, and escalation workflows.

• Practical experience in validating IVR and voice interactions, including speech recognition, DTMF inputs, call routing, transfers, and call termination scenarios.

• Experience in testing APIs, backend integrations, data exchanges, and contact center workflows across enterprise applications.

• Extensive experience in test planning, test case design, defect management, execution reporting, and quality assurance best practices.

• Excellent analytical, troubleshooting, communication, stakeholder collaboration, and documentation abilities.

• Experience with performance, load, stress, and scalability testing of conversational AI and voice applications.

• Familiarity with SIP, telephony protocols, speech recognition technologies, DTMF, and call-routing concepts.

• Experience with test automation frameworks, API testing tools, and CI/CD-enabled QA practices.

• Exposure to Amazon Connect, Genesys Cloud, or other contact center platforms.

• Knowledge of conversational analytics, customer experience monitoring, and AI-driven customer engagement solutions.

🏝️ Benefits

• Comprehensive compensation and benefits package.

• Health insurance.

• Language courses.

• Relocation program.

• Remote work flexibility.

• Professional development opportunities.

• Certification programs.

• Mentorship and talent investment programs.

• Internal mobility opportunities.

• Internship opportunities.

• Engaging projects for leading global clients.

• Inclusive and supportive work environment.

• Open communication.

• Regular team-building company social events.