Senior QA Automation Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Spearhead the quality strategy for the Evolent Platform's web user experience.

• Design and oversee end-to-end, component, accessibility, contract, and test automation for applications built with React and Next.js.

• Take ownership of quality signals that indicate release readiness.

• Create and manage a thorough set of functional, regression, accessibility, performance, and AI-output quality test strategies.

• Engage in code reviews, design discussions, and product planning sessions.

• Establish and maintain test automation patterns and standards.

• Mentor quality engineers and advocate for best practices in testing.

• Lead the Playwright end-to-end and Vitest component test suites.

• Develop contract tests for AG-UI event streams and API tests for backend-for-frontend, .NET, and Python FastAPI services.

• Evaluate streaming behavior and resilience, including retries and timeouts.

• Plan and conduct basic load and performance testing.

• Integrate automated testing suites into GitHub Actions.

• Direct WCAG and Section 508 accessibility testing through both automated and manual methods.

• Assess accessibility defects and assist in conformance reviews.

• Analyze, document, prioritize, and escalate defects as necessary.

• Generate quality metrics and report on quality status and release readiness.

• Present findings during Agile ceremonies and lead sessions for sharing technical knowledge.

• Utilize and validate approved AI-assisted engineering tools for test design, scripts, test data, documentation, troubleshooting, and defect analysis.

• Contribute to reusable AI-assisted testing assets and workflows.

• Adhere to policies regarding AI usage, intellectual property, security, privacy, PHI handling, and Responsible AI.

• Participate in peer reviews and the validation of AI-assisted solutions.

⛳️ Requirements

• Over 5 years of experience in software quality assurance, including at least 3 years of practical test automation for modern web applications.

• Strong hands-on expertise with Playwright using TypeScript or JavaScript for end-to-end automation.

• Familiarity with component testing using Vitest or Jest and React Testing Library.

• Experience in testing React-based web applications, including asynchronous and streaming behavior.

• Practical accessibility testing experience with axe-core and manual screen readers (JAWS, NVDA, VoiceOver) against WCAG 2.1/2.2 AA and Section 508.

• Background in API testing and contract testing, including schema-based validation of APIs or event streams.

• Experience with load or performance testing tools like k6 or JMeter.

• Proficient in creating and maintaining automation jobs in CI/CD tools such as GitHub Actions using YAML.

• Experience with version control systems like Git.

• Knowledge of test management and defect tracking tools such as JIRA or ALM.

• In-depth understanding of functional, regression, accessibility, and performance testing methodologies.

• Experience working within Agile development environments.

• A Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related field, or equivalent experience.

• High-speed internet connection of over 10 Mbps at home.

• Capability to complete identity verification, background checks, in-person I-9 verification, and potentially drug screening prior to employment.

• Ability to comply with restrictions on AI tools during interviews.

🏝️ Benefits

• Maintain a healthy work/life balance.

• Enjoy flexible work arrangements.

• Experience autonomy in accomplishing tasks.

• Access comprehensive benefits, including health insurance options.

• Benefit from equal opportunity employment.

• Receive reasonable accommodation support.