Remotery

Senior AI Safety Clinical Reviewer – TPM

atmpathicUS flagWashingtonFull-timeSenior$140k – $190k/year

Posted May 2

📋 Description

• Develop and enhance a dependable clinical quality assurance and adjudication process across evaluation initiatives, pinpointing deficiencies and refining systems.

• Educate and onboard expert raters on safety guidelines, common standards, and evaluation principles.

• Conduct calibration sessions to minimize discrepancies and enhance consistency.

• Act as the escalation point for unclear or high-stakes discussions.

• Provide adjudicated, high-confidence evaluation datasets for an initial pilot project.

• Exhibit calibrated clinical judgment consistent with mpathic’s safety philosophy.

• Create workflows that can be executed by others without ongoing supervision.

• Oversee clinical quality systems across multiple simultaneous AI safety evaluation projects.

• Design scalable training programs, certification pathways, and feedback mechanisms for expert evaluators.

• Continuously enhance inter-rater reliability, rubric clarity, and reviewer consistency.

• Contribute to shaping mpathic’s long-term strategy for emotionally attuned AI safety quality assurance.


⛳️ Requirements

• Over 5 years of experience in one or more areas: Clinical supervision, training, or peer review.

• Clinical research operations or qualitative assessment.

• Trust & safety, human-centered AI, or behavioral science processes.

• AI evaluation, annotation quality assurance, or rubric-based assessment frameworks.

• Coaching clinicians or experts in applying common standards in critical environments.

• Licensed clinician (LCSW, LMFT, PsyD, PhD, MD) or equivalent practical experience.

• Strong knowledge of psychological stress, trauma, crisis intervention, or mental health concepts.

• Proficiency in evaluating emotionally nuanced discussions for safety, appropriateness, and risk of harm.

• Exceptional judgment in ambiguous situations involving distress, vulnerability, or sensitive disclosures.


🏝️ Benefits

• Comprehensive health, dental, and vision insurance fully funded by the company for full-time staff.

• Furthermore, we provide a 401k plan, wellness programs, and flexible paid time off.

People also viewed

BlueCross BlueShield of South Carolina17 hours ago

RN Medical Reviewer II

US flagSouth Carolina OnlyFull-timemedical-reviewer
ApplyView job
Greenlife Healthcare Staffing22 hours ago

RN Clinical Reviewer – IDR

US flagNew York OnlyFull-timemedical-reviewer$50/hour
ApplyView job
MedlogixMay 7

Medical Review Specialist

US flagMichigan OnlyFull-timemedical-reviewer$48k – $55k/year
ApplyView job
EvolentMay 6

Clinical Reviewer, Nurse – Medical Oncology

US flagCalifornia OnlyFull-timemedical-reviewer$34 – $38/hour
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers