Medical Expert – Part-Time

This is a fully remote position, open to applicants in United States.

📋 Description

• Engaging in roleplaying scenarios related to medical and health issues with AI agents

• Assessing the medical accuracy, clarity, and safety of health information generated by AI

• Conducting red teaming exercises to identify medical edge cases, unsafe guidance, and model failure modes

• Recognizing signs of patient distress, medical risk, or the need for urgency escalation

• Evaluating and rating AI model responses to ensure safety, appropriateness, and harm prevention

• Creating and enhancing medical rubrics, behavioral taxonomies, and evaluation frameworks

• Performing qualitative analyses of AI conversations related to health topics

• Offering expert feedback on internal medical safety initiatives and health policy

• Collaborating with engineers, researchers, and clinicians to establish safety metrics

• Documenting edge cases, near-misses, and patterns of failure

• Upholding strict confidentiality, quality assurance standards, and ethical guidelines

• Engaging in interdisciplinary review and calibration sessions

⛳️ Requirements

• Graduate-level education (past or present) in medicine, nursing, public health, or a related clinical discipline

• Clinical experience in evaluating or managing medical conditions, whether acute, chronic, or complex

• Solid understanding of medical ethics, patient safety, and risk communication

• Proficiency in English and at least one additional language

• Familiarity with AI tools, LLMs, or technologies that support clinical decision-making

• Capability to work remotely using Slack, LLM tools, and Google Docs

• Comfort with ambiguity, adapting guidelines, and working in a feedback-driven environment

• Willingness to sign non-disclosure agreements and work with sensitive or high-risk information

• Availability for up to 10 hours per week and for occasional scheduled meetings

• Completed degree and active professional licensure

• Over 5 years of clinical or applied medical experience

• Experience in emergency medicine, primary care, specialty care, or public health

• Experience engaging with diverse cultures

• Background in health communication, medical education, or patient-facing content

• Experience in trust & safety, content moderation, or medical data labeling

• Interest in AI, NLP, or ML applications within the healthcare sector

• Experience in reviewing or developing clinical guidelines or protocols

• Involvement in online communities (e.g., Discord, Reddit, professional forums)

• Experience working across different cultures or healthcare systems on an international scale

🏝️ Benefits

• Competitive compensation

• Opportunity to work with innovative AI technology

• Flexible working hours and remote options

• Collaborative and supportive team environment

• Professional development and growth opportunities