Staff Software Development Engineer – Test

This is a fully remote position, open to applicants in Idaho.

📋 Description

• Develop automation frameworks and standards that are utilized by other teams.

• Create structures, fixtures, and shared methodologies for dependable parallel execution, considering concurrency, asynchronous behavior, and eventual consistency.

• Establish testing practices that engineers adhere to and promote their adoption through practicality and influence.

• Take ownership of the quality strategy across various teams.

• Define verification approaches based on system risk and identify the necessary evidence at each layer.

• Guide exploratory testing towards unknown failure modes.

• Document aspects that are intentionally not tested and the rationale behind it.

• Manage the speed of test execution, gating processes, failure classification, and flake discipline.

• Empower developers to independently resolve test failures.

• Develop a synthetic data strategy, isolation patterns, and CI safeguards to prevent PHI from being introduced into non-production environments.

• Define the requirements for environment, observability, and data in collaboration with the Platform team.

• Establish the depth of verification for performance, resilience, accessibility, and security.

• Author versioned and reviewable conventions for AI agents.

• Set limitations on agent actions that do not require human review.

• Retain human oversight over generated tests and evidence.

• Determine technical direction across teams, influencing the roadmap, tooling, and engineering trade-offs.

• Mentor engineers in the testing standards that have been adopted.

⛳️ Requirements

• Proficient in a modern programming language.

• Capable of reasoning about concurrency, asynchronous workflows, and failure propagation across services.

• Able to trace failing tests across services utilizing logs, traces, and deployment context.

• Skilled in identifying whether root causes are related to product, automation, data, or environmental issues.

• Effective in communicating residual risk clearly to Engineering and Product teams.

• Possess significant expertise in at least one non-functional area: performance, resilience, security, or accessibility.

• Already operates with an AI-first mindset and has set conventions that are followed by other engineers.

• Experienced in building a testing framework or shared automation platform that has been adopted by multiple engineers or teams.

• Has established testing standards and best practices, including guidance on test layers, flake policy, and gating criteria.

• Experienced in designing or evolving a quality system across teams.

• Capable of translating product and architectural risks into a verification strategy.

• Has influenced technical direction beyond their own team, affecting the roadmap, tooling, and engineering trade-offs.

• Experienced in mentoring fellow engineers into established standards.

• Bonus: experience validating LLM-backed or other non-deterministic products.

• Bonus: familiarity with synthetic data strategies and deterministic isolation for sensitive information.

• Bonus: experience with failure injection or recovery testing in production-like environments.

• Bonus: background working in healthcare, other regulated domains, or systems that manage sensitive customer data.

🏝️ Benefits

• Comprehensive benefits package.

• Paid Time Off (PTO).

• Medical insurance.

• Dental insurance.

• Vision insurance.

• 401(k) plan with matching contributions.

• Extensive Employee Assistance Program (EAP).

• Wellness program.