This is a fully remote position, open to applicants in Minnesota.

📋 Description

• Analyze clinical EHR vignettes alongside questions, suggested answers, and distractor answers related to diagnosis and treatment tasks.

• Evaluate vignettes covering cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.

• Assess the quality of clinical reasoning, the accuracy and completeness of vignettes, the transparency of answers, correctness and gradeability of responses, and the quality of distractors.

• Confirm if reasoning paths lead to answers based solely on the facts presented in the vignettes.

• Amend reasoning paths and compose brief rationales.

• Conduct three independent blind evaluations followed by adjudication by a physician.

• Adhere to deadlines for task submissions and fulfill specified acceptance criteria.

⛳️ Requirements

• Must be a US-based, actively practicing physician.

• Hold a medical degree (MD or DO).

• Possess an active, unrestricted US medical license, validated by the issuing medical board.

• Have board certification or have completed residency training.

• Recent hands-on patient care experience is preferred, ideally at the attending level.

• Extensive experience in diagnostic and treatment approaches across multiple systems in internal, family, emergency, or hospital medicine.

• Demonstrate strong clinical reasoning skills, including differential diagnosis, management of next steps, and the implementation of evidence-based guidelines.

• Proficient in written English (C1+ level).

• Experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is advantageous.

• Not appropriate for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare roles.