QA Automation Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Create API and end-to-end testing suites utilizing AI coding agents that generate tests based on specifications, pull requests, and provider documentation.

• Establish the Quality Assurance MCP toolset (including Playwright, browser, database, logs, and Jira) to enable agents to execute and troubleshoot tests.

• Design self-healing tests where agents identify flaky failures and suggest corrective actions.

• Execute tests within CI/CD pipelines, incorporating an AI test gap analysis with each pull request.

• Manage test data and environments effectively.

⛳️ Requirements

• Over 3 years of experience in test automation.

• Proficient in TypeScript / JavaScript (familiarity with Playwright, Jest, or similar frameworks).

• Experience with CI pipelines.

• Regular utilization of AI coding agents.

• Practical experience with MCP (Playwright MCP or equivalent).

• Developed a custom MCP server or agent for the purpose of testing.

• Conducted LLM evaluations: designed evaluation sets for AI functionalities and AI-generated tests.

• Understanding of AI-related risks in testing tools, such as prompt injection and agent access to test data and secrets.

• Nice to Have: Experience with load testing (k6).

• Nice to Have: Experience with contract testing.

🏝️ Benefits

• Comprehensive health and wellness plans.

• Flexible working hours and remote work options.

• Opportunities for professional development and growth.

• Collaborative and innovative work environment.