Head of Testing and Automation

This is a fully remote position, open to applicants in United States.

📋 Description

• Collaborate with Engineering and Product teams to outline the testing and automation roadmap, focusing on priority workflows and potential release risks.

• Create reusable test infrastructure, repeatable environments, test data, and CI/CD integration across designated product surfaces.

• Develop AI-assisted methods for test creation, exploration, maintenance, and failure investigation.

• Assess the applicability of computer-use agents in relevant areas.

• Establish significant assertions, reproducible failure evidence, and release criteria to independently verify agent output.

• Track escaped defects, flaky tests, verification time, false positives, and maintenance efforts.

• Encourage team adoption through effective implementation, thorough documentation, and coaching.

• Set the technical direction and create practical systems that validate product behavior, detect regressions, and minimize repetitive testing tasks using AI.

⛳️ Requirements

• Strong background in software engineering with hands-on experience in automation, quality infrastructure, developer tooling, or similar systems.

• Proven ability to ensure reliable verification in a delivery pipeline and troubleshoot failures across code, data, and infrastructure.

• Practical experience in building with large language models (LLMs) or agents and assessing their outputs.

• Technical leadership experience across teams, demonstrating clear judgment regarding quality, delivery, and trade-offs in adoption.

• Familiarity with browser or computer-use agents, Playwright or similar automation tools, AI evaluation, and sensitive-data products.

• Strong prioritization skills with a focus on impact over perfection.

• Member-first approach emphasizing responsiveness, peace of mind, outcomes, truth, clarity, and care.

• Excellent communication skills, with the ability to collaborate effectively around shared objectives.

• A mindset of radical ownership, relentless execution, urgency, precision, initiative, and follow-through.

• Values of honesty, transparency, respect, and sustained integrity.

• A commitment to accuracy, quality, clarity, and clinical precision.

🏝️ Benefits

• Competitive salary and benefits package.

• Flexible working hours.

• A dynamic work environment that fosters creativity and innovation.