Senior Test Automation Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Take charge of the test automation strategy for a specific product domain.

• Create scalable and maintainable frameworks, fixtures, and utilities for engineering teams.

• Collaborate with engineers to enhance testability and leverage AI-assisted test generation.

• Conduct pre-release risk evaluations and establish test matrices that encompass integrations, environments, and customer workflows.

• Spearhead test planning for high-risk releases and hotfixes, assisting in defining go/no-go signals.

• Transform radiologist personas and actual workflows into comprehensive test cases.

• Validate customer-specific environments, including Windows and Electron workstations, dictation systems, and PACS/RIS integrations.

• Minimize flaky and low-signal tests, triage failures, decrease suite execution time, and enhance test data and environment stability.

• Lead or co-lead performance and load testing, security assessments, accessibility checks, and compliance coverage, such as HIPAA-related auditability.

• Develop evaluations for non-deterministic AI outputs, including speech recognition and generated impressions.

• Utilize incident reviews and customer-reported defects to expand regression coverage and update risk profiles.

• Monitor escaped defects, test stability, and time to detect; maintain organized test cases and transparent results.

• Mentor test automation engineers and software engineers, offer guidance to Engineering Managers on risk and release readiness, and contribute to hiring, onboarding, and the Quality community.

⛳️ Requirements

• Over 6 years of experience in software engineering or test automation, including more than 3 years in designing and owning automation frameworks.

• Proficient programming skills in TypeScript and/or Python; familiarity with an object-oriented language such as C# or Java is advantageous.

• Extensive experience with end-to-end frameworks like Playwright, Selenium, or Cypress.

• API testing experience across REST and GraphQL services, understanding the interaction of tests with data and downstream dependencies.

• Proven experience in integrating tests into CI/CD pipelines, such as GitHub Actions or CircleCI, including PR-level gating, parallelization, and reporting.

• A history of reducing flakiness and suite runtime, supported by data.

• Experience in risk-based test strategy for integration-heavy systems across various customer configurations.

• Strong debugging abilities across services, data, and environments, with a solid understanding of SQL, logs, and observability tools.

• Shift-left mentality and experience assisting developers in taking ownership of their tests.

• Practical experience with AI tools for writing, maintaining, and triaging tests, demonstrating judgment in reviewing outputs.

• Detail-oriented, collaborative, capable of influencing without direct authority, with effective communication skills and experience mentoring engineers.

• Experience in healthcare or regulated environments is a plus.

• Familiarity with radiology systems such as PACS, RIS, dictation platforms, HL7/FHIR, FHIRcast, or DICOM is desirable.

• Experience in automating Windows desktop or Electron applications is a plus.

• Background in testing ML, AI, or speech systems is advantageous.

• Experience with performance or load testing and security assessments within pipelines is a plus.

• Knowledge of AWS or Google Cloud, along with Docker or Terraform, is a plus.

• Familiarity with test case management systems like Testmo or quality dashboards like Grafana is desirable.

• Must possess legal authorization to work in the US.

🏝️ Benefits

• Comprehensive Medical, Dental, Vision & Life insurance.

• HSA (with employer match), FSA, & DCFSA.

• 401(k) plan.

• 11 Paid Company Holidays.

• Flexible PTO policy.

• Annual company-wide offsite.

• Periodic team offsites.

• Annual equipment stipend.