This is a fully remote position, open to applicants in Wisconsin.

📋 Description

• Analyze clinical EHR vignettes accompanied by questions, suggested answers, and distractor trap answers related to diagnosis and treatment tasks.

• Evaluate vignettes covering the cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.

• Assess the quality of clinical reasoning, accuracy and completeness of vignettes, correctness and gradeability of answers, as well as the quality of trap responses.

• Verify that reasoning chains derive answers solely from the facts presented in the vignettes.

• Correct reasoning pathways and compose brief rationales.

• Engage in three independent blind reviews, followed by physician adjudication.

• Undertake project tasks for approximately 10–20 hours per week during active project phases.

⛳️ Requirements

• Must be a US-based, actively practicing physician holding an MD or DO degree.

• Possess an active, unrestricted US medical license, validated by the issuing medical board.

• Hold board certification or have completed residency training.

• Recent experience in direct patient care is required; attending-level experience is preferred.

• Extensive, multi-system diagnostic and treatment proficiency in internal medicine, family medicine, emergency medicine, or hospital medicine.

• Strong clinical reasoning skills, including differential diagnosis, next-step management, and application of evidence-based guidelines.

• Previous experience in medical AI evaluation, clinical content or exam question review, or medical annotation/QA is advantageous.

• Excellent written English skills (C1+ level).

• This position is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or those with non-clinical healthcare titles.

• All tasks must be submitted by specified deadlines and meet the established acceptance criteria.