Senior Quality Automation Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Gain insights into how customers interact with the platform through healthcare quality, coaching, compliance, operations, analytics, and customer experience workflows.

• Convert workflows, acceptance criteria, production challenges, and known risk factors into automated test scenarios.

• Identify which aspects should be automated, select the appropriate testing layer, and determine the necessary coverage.

• Balance testing across UI, API, integration, and data levels.

• Design, develop, maintain, and troubleshoot automated tests for UI workflows, APIs, backend services, data pipelines, integrations, reporting, and AI-driven features.

• Create and manage smoke, regression, acceptance, integration, and end-to-end test suites.

• Utilize Playwright to automate essential user journeys and product workflows.

• Employ Bruno/Postman to verify APIs, payloads, integrations, authentication, error handling, and backend behavior.

• Use SQL to ensure data accuracy, workflow integrity, processing results, reporting outputs, and customer-facing analytics.

• Develop reusable automation utilities, fixtures, helpers, and test data patterns.

• Integrate automated tests into CI/CD pipelines.

• Investigate flaky tests, environmental issues, timing discrepancies, and test data failures.

• Identify high-risk coverage gaps and create automation solutions to address them.

• Collaborate with Product, Engineering, Data Science, Implementation, and Customer teams on requirements, risks, and usage.

• Enhance testability, observability, logging, test data configuration, and API contracts.

• Analyze failures using logs, monitoring tools, database queries, API responses, and product data.

• Report defects, automation deficiencies, and release risks.

• Share automation patterns and testing methodologies.

• Develop automated validation for classifications, model outputs, prompt and configuration changes, structured responses, extraction workflows, and downstream behaviors.

• Create repeatable test scenarios for both deterministic and semi-deterministic AI behaviors.

• Validate expected outputs, required fields, edge cases, failure conditions, and impacts on downstream workflows.

• Utilize representative test data and known expected outcomes to identify regressions.

• Collaborate with Data Science and Engineering to enhance the testability and regression coverage of AI features.

⛳️ Requirements

• Over 5 years of experience in test automation, SDET, or software engineering, with direct ownership of automated test suites.

• Proficient in production-level coding in at least one of the following languages: TypeScript, JavaScript, C#, or Python.

• Experience with Playwright or similar modern UI automation tools for complex web applications.

• Expertise in REST API testing (using Bruno, Postman, or code-based methods), including authentication, payload validation, and error handling.

• SQL proficiency for validating data integrity and processing outcomes.

• Knowledge of CI/CD integration, including failure triage, flaky test diagnosis, and test data management.

• Ability to evaluate product risks and select the appropriate testing layer (UI, API, or data) without needing exhaustive case definitions.

• Experience in validating asynchronous, multi-service workflows.

🏝️ Benefits

• Opportunity for professional growth and development.

• Work in a dynamic and innovative environment.

• Collaboration with cross-functional teams to enhance product quality.

• Access to cutting-edge tools and technologies.