Behavioral Health Expert – AI Safety, Model Evaluation

This is a fully remote position, open to applicants in United States.

📋 Description

• Analyze interactions between users and AI models regarding relationship and family guidance, emotional wellness, spiritual and metaphysical inquiries, as well as unconventional or unfounded beliefs.

• Evaluate whether model responses are neutral, suitable, and safe.

• Identify and document issues such as excessive agreement, bias, reinforcement of distorted or unfounded beliefs, moralizing, or encroaching on clinical or directive advice.

• Create rubrics, guidelines, and reference responses to ensure balanced, supportive, and appropriately limited replies.

• Design testing scenarios and dialogues for sensitive, non-crisis topics.

• Collaborate with laboratory researchers and fellow experts to uphold consistent, calibrated, and well-documented evaluation standards.

⛳️ Requirements

• A degree in psychology, counseling, social work, behavioral health, behavioral science, human services, or a closely related discipline, or equivalent professional experience in the mental health sector.

• Over 3 years of professional experience assisting individuals in a mental health, counseling, or social services environment.

• Capacity to remain neutral and nonjudgmental across a variety of perspectives, relationships, belief systems, and worldviews.

• Ability to articulate the rationale behind professional judgments.

• Working knowledge of sycophancy, cognitive distortions, healthy boundaries, and client-centered methodologies such as motivational interviewing.

• Availability to engage reliably for at least 20 hours per week during weekdays.

• Strong written communication skills with the ability to provide precise, well-structured feedback in writing.

• Clinical licensure is preferred but not mandatory.

• Nice to have: experience in AI safety, applied ethics, trust and safety, or content policy.

• Nice to have: background in couples, family, or relationship counseling.

• Nice to have: familiarity with spiritual care, religious or alternative belief communities, or the psychology of misinformation and conspiracy theories.

• Nice to have: previous experience in evaluating, annotating, or red teaming AI systems.

• Unable to support H1-B or STEM OPT candidates at this time.

🏝️ Benefits

• W-2 employment with payroll, benefits, and compliance managed through Cincinnatus LLC.

• Weekly payments via Stripe or Wise based on services provided.

• Fully remote work environment.

• Flexible scheduling options.

• Opportunity to collaborate with leading AI laboratories and researchers.

• Chance to contribute to the development of next-generation AI systems.

• Referral bonuses of up to $1,120 for each successful referral, subject to certain limits.