Senior Clinical QA Specialist – AI

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop, implement, and enhance QA frameworks for AI tools, which include testing protocols, evaluation rubrics, monitoring systems, and review processes

• Perform pre- and post-production evaluations and audits of AI outputs to ensure clinical safety, accuracy, bias mitigation, and compliance with therapeutic, ethical, and regulatory standards

• Assess AI-related escalations from therapists, clients, and customer support teams; discern patterns, severity levels, and escalation pathways

• Analyze QA findings and trends to generate actionable Clinical AI QA reports and recommendations regarding AI features, model behavior, prompts, guardrails, and workflows

• Establish and manage clinical AI risk and escalation pathways in collaboration with Legal, Compliance, Clinical Operations, and other cross-functional teams

• Assist in clinical risk assessments for new and developing AI capabilities, including identifying failure modes and implementing safeguards

• Stay updated on emerging AI QA and evaluation methodologies, tools, research, and best practices within the healthcare industry

• Contribute to research studies and evaluations concerning AI efficacy, safety, quality, and new evaluation methods

• Support initiatives of the Clinical Department such as office hours, newsletters, and team programs

• Represent BetterHelp at public events, webinars, presentations, and conferences as appropriate

⛳️ Requirements

• Graduate degree (Masters or Doctorate) in counseling, psychology, or social work

• Clinical background in mental health, including psychotherapy, telemedicine, digital mental health, or related care settings

• Familiarity with emerging AI regulatory frameworks and best practices for AI in the mental health sector

• Experience in AI, technology, or data science applications within healthcare environments

• Understanding of quality assurance, auditing, and compliance processes, including privacy, security, and confidentiality standards in mental health care

• Strong communication abilities to convey clinical expertise into operational and product guidance for AI systems

• Excellent analytical and problem-solving capabilities; able to thrive in fast-paced, data-driven settings

• Experience working collaboratively with cross-functional teams

• A growth mindset, curiosity, and a passion for enhancing mental health care through safe and innovative technologies

• Broad knowledge of evidence-based therapeutic approaches and current clinical trends

• Preferred: specialized degrees, certifications, or training in AI

• Preferred: familiarity with LLM evaluation methods and/or direct experience in AI evaluation

• Preferred: background in data analytics or research

• Preferred: ability to quickly learn new technologies and processes with minimal supervision

🏝️ Benefits

• Remote work with regular in-person bonding activities sponsored by the company

• Competitive salary

• Comprehensive perks program (including free therapy, employee wellness initiatives, and more)

• Outstanding health, dental, and vision insurance

• 401k benefits with employer matching contributions

• Opportunity to create something that changes lives – and that people truly appreciate

• Any hardware or software that will enhance your happiness and productivity

• An incredible community of colleagues

• Performance bonus

• Travel expenses covered for necessary in-person collaboration and company-wide offsite events