
Physician Reviewer, MD/DO β Medical AI Evaluation
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in United States.
β’ Assess clinical EHR vignettes alongside questions, suggested answers, and distractor trap answers related to diagnosis and treatment tasks.
β’ Evaluate the quality of clinical reasoning, the accuracy and completeness of vignettes, correctness of answers, gradeability, and quality of traps.
β’ Determine if reasoning leads to answers based solely on the facts presented in the vignette.
β’ Correct reasoning pathways and compose brief rationales.
β’ Engage in three independent blind readings followed by physician adjudication.
β’ Execute project tasks via the platform and submit them for approval.
β’ Possession of a medical degree (MD or DO).
β’ Active and unrestricted US medical license, verified at onboarding and re-verified monthly.
β’ Board certification or completion of residency training.
β’ Experience in direct patient care; attending-level experience preferred.
β’ Extensive diagnostic and treatment experience across multiple systems in internal, family, emergency, or hospital medicine.
β’ Strong clinical reasoning skills, including differential diagnosis, next-step management, and adherence to evidence-based guidelines.
β’ Proficient written English skills (C1+ level).
β’ Previous experience in medical AI evaluation, clinical content or exam question review, or medical annotation/QA is advantageous.
β’ Must be a licensed physician in the US.
β’ Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or those holding non-clinical healthcare titles.
β’ Compensation per approved task: a predetermined fixed rate for each task, established beforehand.
β’ Fully self-scheduled: no minimum hours required and no fixed schedule.
β’ Opportunity for remote work.
β’ No patient interactions and no risk of malpractice exposure.
β’ One-time onboarding reward of $50, paid once your first approved task is completed.
β’ Quality incentives: additional earnings for high-quality approved tasks.
β’ Flexible participation that accommodates other commitments.
Atmosera
Cardinal Health
Mistral AI
Zoetis
Get handpicked remote jobs straight to your inbox weekly.