Senior/Staff QA Engineer – Agentic AI Platform

This is a fully remote position, open to applicants in California, +2 more states.

📋 Description

• Assist in a vital customer engagement as a Senior/Staff QA Engineer.

• Take ownership of quality from end-to-end for a rapidly evolving agentic AI product.

• Collaborate closely with the Delivery Lead/Solutions Architect and engineering stakeholders to guarantee product quality, starting from initial test planning all the way through to final release.

⛳️ Requirements

• A minimum of 5 years of professional QA experience, including at least 2 years in a senior or staff role.

• Proven experience in testing production software throughout the entire Application Development Lifecycle (ADLC).

• Strong comprehension of the Application Development Lifecycle, from requirements gathering to release and support.

• Solid understanding of UI/UX principles, with the ability to assess usability and identify design or interaction issues beyond just functional bugs.

• Hands-on experience in testing AI Agent scenarios, including conversational flows, agent decision-making, tool/function invocation, and handling edge-case or failure-mode behavior.

• Established experience with automated testing frameworks and the construction of maintainable, scalable test suites.

• Capability to set up and manage a Playwright cluster for executing automated end-to-end (E2E) tests against a live agent platform.

• Ability to independently create clear and well-structured test cases from ambiguous or evolving product requirements.

• Experience in leading the full E2E QA lifecycle, including test planning, execution, defect triage, regression, and sign-off.

• In-depth expertise with Playwright, including cluster management and parallel execution.

• Proficiency in JavaScript / TypeScript or Python for developing automation scripts.

• Familiarity with testing outputs from large language models (LLMs), prompt evaluation frameworks, or tools for conversational AI testing.

• Experience in integrating automated test suites into CI/CD pipelines (e.g., GitHub Actions, GitLab CI, Jenkins) and working with Docker containerization.

• Proficiency with Git, Jira, and contemporary test management tools.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Flexible working hours and remote work options.

• Opportunities for professional development and continuous learning.

• Comprehensive health and wellness benefits.

• Collaborative and innovative work environment.