Software Test Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and implement testing plans for a variety of products, APIs, SDKs, model-driven features, and data platforms.

• Create, establish, and sustain automated test suites for functional, integration, end-to-end, regression, API, browser, and service-level testing.

• Convert product specifications and customer acceptance criteria into testing strategies, test cases, and release checkpoints.

• Generate customer-centric and adversarial test datasets, fixtures, and testing environments.

• Assess speech-to-text, text-to-speech, and other AI model functionalities using metrics, expected results, human evaluations, and regression coverage.

• Construct test harnesses, reusable scripts, test-data tools, result-aggregation pipelines, dashboards, and visual representations.

• Incorporate automated testing, quality checks, canaries, and release validation into CI/CD processes.

• Collaborate with Engineering, Product, Research, Data, Infrastructure, and DevOps teams to address test coverage and deployment risks.

• Test data ingestion, processing, annotation, and quality control workflows.

• Carry out staging and production validation, load and reliability testing, cross-browser testing, customer workflow testing, and user acceptance testing.

• Oversee test repositories, automation coverage, documentation, and release readiness reporting.

• Create detailed bug reports and engage in triage and escalation processes.

• Contribute to code reviews, test design reviews, and technical discussions.

⛳️ Requirements

• Bachelor's, Master's, or PhD in Computer Science, AI, Applied Mathematics, or a related discipline, or equivalent experience.

• Over 5 years of professional experience in software or QA engineering.

• Proven history of delivering test infrastructure or evaluation systems.

• Strong backend/scripting expertise in Python, Rust, Go, or a similar programming language.

• Experience in designing and building automated test pipelines, evaluation frameworks, or data-processing systems.

• Excellent analytical skills and the ability to interpret metrics, thresholds, and statistical variations.

• Competence in tackling ambiguous technical challenges and effectively communicating with research, engineering, and product teams.

• Experience in testing or evaluating AI systems such as LLMs, RAG pipelines, agents, or multimodal models.

• Familiarity with voice, audio, speech recognition, or real-time systems, including metrics like WER, MOS, latency, and time-to-first-byte.

• Knowledge of cloud infrastructure, containers, temporary test environments, CI/CD systems, and monitoring tools.

• Previous participation in open-source projects.

🏝️ Benefits

• Equity

• 10% Annual Bonus

• Remote work arrangement