QA Engineer – AI-Assisted Testing

This is a fully remote position, open to applicants in United States.

📋 Description

• Utilize AI tools such as Claude, Claude Code, Cursor, or ChatGPT to assess tickets, merge requests, and code diffs; recognize risks and edge cases; draft test charters and checklists; and prioritize testing efforts.

• Conduct risk-based exploratory, functional, and regression testing on the Vue dashboard, admin tools, email notifications, and integrations.

• Confirm document retrieval, parsing, categorization, storage, and delivery across court portals, 2FA/OTP logins, and integrations like Clio, Filevine, iManage, and NetDocuments.

• Evaluate backend and platform modifications utilizing API calls, SQL queries, logs, and Grafana/Loki and Sentry dashboards.

• Create realistic test data, court notice emails, and edge-case documents using AI; manage simulators and testing environments.

• Assess AI document categorization and an MCP server employed by AI assistants; evaluate accuracy and consistency, test atypical or hostile inputs, and detect regressions.

• Test password, SAML SSO, and OAuth logins, as well as user roles and permissions, and ensure tenant data isolation.

• Investigate and replicate customer-reported and production issues; compose actionable bug reports.

• Optionally, develop targeted automated checks, including Playwright scripts or API checks, for high-risk scenarios.

• Collaborate with engineers and product managers during sprint planning, backlog refinement, and retrospectives.

• Assist in writing testable acceptance criteria and proactively raise quality risks.

⛳️ Requirements

• 3 to 7 years of experience in software quality assurance for web or SaaS applications.

• Extensive experience in exploratory and manual testing of intricate, data-intensive systems.

• Daily utilization of AI assistants in testing, which includes generating test ideas, edge cases, test data, SQL/log queries, log or diff summaries, bug reproduction, and reports.

• Proficiency in prompting AI assistants with pertinent context.

• Capability to verify AI output and confidently identify incorrect results.

• Understanding of testing nondeterministic AI features through repeated trials, sample sets, and correctness checks.

• Safe handling of data using synthetic or masked data with AI tools.

• Comfort with command line operations, Git, and log analysis.

• Some familiarity with Docker or Kubernetes is advantageous.

• Experience with defect tracking and test management using Jira.

• Proficiency in writing or maintaining automated tests, such as Playwright, Selenium, or API test scripts.

• Experience testing AI or LLM features, including classification accuracy, hallucinations, and prompt injection.

• SQL skills for PostgreSQL.

• Experience testing APIs with Postman, curl, or Bruno; understanding of HTTP, REST, and JSON.

• Knowledge of web security testing, including authentication, sessions, roles and permissions, OAuth2/SAML, CSRF, and XSS.

• Experience utilizing AI browser tools, such as Playwright MCP or browser agents.

• Experience testing third-party integrations, email-driven workflows, or browser automation against external sites.

• Familiarity with accessibility testing (WCAG 2.2 AA).

• Knowledge of the legal domain, particularly court e-filing, docketing, or legal document management.

• ISTQB or a similar QA certification.

• Understanding of or experience with the Lean Startup methodology.

• Keen attention to detail, curiosity, and a systematic approach.

• Strong written and verbal communication skills.

• Ability to take ownership and discover ways to test seemingly untestable functionalities.

🏝️ Benefits

• Fully remote position available to all US time zones, including Hawaii.

• Flexible working hours.

• Options for health, dental, vision, and life insurance.

• Discretionary time off (DTO), in addition to scheduled vacations and holidays, subject to supervisor approval.

• Employee stock option plan.

• Company-provided AI tools.

• Supportive environment focused on achieving work objectives.