QA Engineer, AI Voice

This is a fully remote position, open to applicants in Poland.

📋 Description

• Conduct end-to-end, API, integration, regression, and release testing on voice journeys across various markets and configurations.

• Prepare test data and define expected outcomes.

• Assist business testers during User Acceptance Testing (UAT).

• Execute and expand automated test suites and evaluation sets created by the Senior team.

• Record defects with detailed reproduction steps and transcripts, ensuring they are followed through to resolution.

• Identify and communicate risks and blockers at an early stage.

⛳️ Requirements

• A minimum of 3 years of experience in software quality assurance.

• At least 1 year of experience in testing voice or conversational AI applications.

• Practical experience in testing voice agents, including knowledge of speech recognition and output fundamentals, intents, latency, and transcript analysis.

• Comprehension of why identical inputs may yield different outputs from AI and how to effectively test for this variability.

• Experience with API testing and basic automation using Python or JavaScript/TypeScript.

• Familiarity with Jira or Azure DevOps along with a test management tool.

• Capable of troubleshooting using logs and transcripts.

• Strong written and verbal communication skills.

• Proficiency in English at a minimum B2 level.

• Experience with voice testing platforms such as Hamming, Cekura, Coval, or Botium is advantageous.

• Familiarity with LLM evaluation tools like Promptfoo, DeepEval, or LangSmith is a plus.

• Basic understanding of telephony concepts (SIP, Twilio, Azure Communication Services) is a plus.

• ISTQB certification is considered an asset.

• Experience in Responsible-AI testing (including PII, bias, and safety) is an added advantage.

• Experience in validating customer journeys across multiple markets is beneficial.

🏝️ Benefits

• Stable employment with a reputable employer established in the market since 2008.

• “Office as an option” model: the flexibility to work remotely or from the office.

• Workation opportunities as per the workation policy.

• Recognized as a Great Place to Work® certified employer.

• Flexible working hours and preferred contract forms.

• Comprehensive online onboarding program with a dedicated “Buddy” from day one.

• Collaboration with top-tier engineers and industry experts.

• Unlimited access to the Udemy learning platform starting from day one.

• Certificate training programs available.

• Support for upskilling, capability development programs, Competency Centers, knowledge sharing sessions, community webinars, and over 110 training opportunities each year.

• Internal promotion and career advancement opportunities.

• A diverse, inclusive, and values-driven community.

• Autonomy in choosing your preferred work style.

• Referral bonuses available.

• Activities that promote well-being and health.

• Opportunities to contribute to charities and support environmental initiatives.

• Modern office equipment provided or available for borrowing, depending on your location.