Staff AI Test Automation Engineer

This is a fully remote position, open to applicants in Minnesota.

📋 Description

• Develop and enhance AI-driven test automation workflows utilizing tools like Claude Code, where AI agents create, execute, and refine Playwright tests.

• Advance the Playwright test framework, incorporating patterns, page-object models, fixtures, and conventions.

• Establish feedback mechanisms between local test execution, CI pipeline outcomes, and merge request creation.

• Lead the transition from Geb/Spock to Playwright while ensuring coverage continuity.

• Integrate and streamline Playwright execution within GitLab CI/CD, implementing quality gates for merge requests and deployments.

• Enhance test feedback through techniques such as parallelization and caching.

• Instrument tests to track pass/fail trends, flakiness rates, and coverage gaps.

• Focus on AI-driven test generation for high-value areas that are currently uncovered.

• Identify scenarios suitable for API-layer automation or contract tests, rather than end-to-end testing.

• Create automation for claims systems, contract testing, system integrations, and comprehensive user journeys.

• Refine prompts, context structures, and validation patterns to boost the accuracy of first-pass AI-generated tests.

• Collaborate with QA, Engineering, and Product teams to enhance regression coverage, speed up delivery, and minimize production defects.

⛳️ Requirements

• Over 10 years of experience in test automation engineering, SDET, or software engineering with a strong emphasis on testing practices.

• Practical experience with Agentic AI tools such as Claude Code, Cursor, GitHub Copilot, or equivalent for generating and maintaining code at scale.

• Hands-on experience with Playwright or a similar modern end-to-end testing framework.

• Proficiency in TypeScript or JavaScript, with the capability to produce production-quality code.

• Familiarity with CI/CD pipelines, preferably within GitLab, including pipeline configuration, test stages, and merge request processes.

• Strong understanding of REST API testing, including when to apply API-level tests versus UI-level tests.

• Practical experience in creating test automation for claims systems, contract testing, integrations, and user flow journeys.

• Experience in migrating legacy test automation to a modern framework while preserving coverage.

• Excellent communication skills, with the ability to convey technical trade-offs to non-technical stakeholders.

• Capability to produce clear documentation.

• A builder mindset focused on systems, feedback loops, and leveraging automation.

• Comfort in navigating ambiguity.

• Current authorization to work in the United States.

• Nice-to-have: Knowledge of Groovy, Spock, or Geb; experience with Pact or similar; background in health insurance, benefits administration, or regulated industries; familiarity with internal developer tooling or productivity platforms.

🏝️ Benefits

• Coverage for alternative medicine.

• Flexible paid time off (PTO).

• Up to 16 weeks of paid parental leave.

• Paid holidays.

• 401(k) retirement plan.

• Transportation benefits.

• Education reimbursement program.

• 2 days of paid paw-ternity leave.

• Comprehensive health and wellness benefits.