Physician MD/DO – Medical AI Evaluation

This is a fully remote position, open to applicants in United States.

📋 Description

• Assess clinical EHR vignettes alongside questions, proposed answers, and distractor trap answers related to diagnosis and treatment tasks.

• Evaluate the quality of clinical reasoning, accuracy and completeness of vignettes, correctness and gradeability of answers, and quality of traps.

• Determine if reasoning arrives at the answer solely based on vignette facts.

• Correct reasoning paths and compose brief rationales.

• Engage in three independent blind reads followed by physician adjudication.

• Complete tasks by specified deadlines and satisfy established acceptance criteria.

⛳️ Requirements

• Must be a US-based, actively practicing physician with an MD or DO.

• Possess an active, unrestricted US medical license, validated with the issuing medical board.

• Hold board certification or have completed residency training.

• Have recent direct patient care experience, with attending-level experience preferred.

• Possess extensive, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.

• Exhibit strong clinical reasoning abilities, including differential diagnosis, next-step management, and the utilization of evidence-based guidelines.

• Demonstrate strong written English proficiency (C1+).

• Previous experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is advantageous.

• Must not be a medical student, unlicensed medical graduate, non-physician clinician, or a non-clinical healthcare professional.

🏝️ Benefits

• Participation is project-based.

• Offers part-time, non-permanent projects.

• Provides a flexible workload estimated at 10–20 hours per week during active project phases.