Physician, Medical AI Evaluation

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Assess clinical EHR vignettes alongside questions, suggested answers, and distractor options related to diagnosis and treatment tasks

• Evaluate benchmark items for vignette precision, thoroughness, answer clarity, correctness, gradeability, and quality of distractors

• Determine if reasoning pathways lead to conclusions based solely on vignette information

• Revise reasoning trails and compose concise rationales

• Engage in three independent blind reads followed by physician adjudication

• Fulfill project tasks within established timelines and meet specified acceptance criteria

⛳️ Requirements

• Actively practicing physician holding an MD or DO medical degree

• Possess an active, unrestricted US medical license, verified during onboarding and re-validated monthly

• Must reside outside of the United States

• Board certification or completion of residency training is required

• Recent direct patient care experience; attending-level experience preferred

• Comprehensive, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine

• Excellent clinical reasoning skills, including differential diagnosis, next-step management, and adherence to evidence-based guidelines

• Proficient written English (C1+ level)

• Curriculum Vitae submitted in English with indication of English proficiency

• Not applicable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare titles

🏝️ Benefits

• Compensation per approved task, approximately $100/hr equivalent flat rate

• One-time onboarding bonus of $50 after the initial production task is approved

• Opportunities for additional earnings based on high-quality approved tasks

• Flexible contribution schedule that accommodates clinical practice

• Opportunity to contribute anytime, from any location

• No patient interaction and no risk of malpractice exposure

• Participation is project-based