
Physician Reviewer, MD/DO – Medical AI Evaluation
Posted Nov 13

Posted Nov 13
This is a fully remote position, open to applicants in United States.
• Assess clinical EHR vignettes alongside questions, suggested answers, and distractor options related to diagnosis and treatment tasks.
• Evaluate the quality of clinical reasoning, accuracy and completeness of vignettes, correctness and gradeability of answers, and quality of distractors.
• Verify if reasoning chains derive answers solely from vignette facts.
• Correct reasoning pathways and compose brief rationales.
• Conduct three independent blind reviews per case, followed by physician adjudication.
• Complete qualification(s), join the project, submit tasks via the platform, and receive payment for approved tasks.
• Medical degree (MD or DO).
• Active, unrestricted US medical license, verified at onboarding and re-checked monthly.
• Board certification or completion of residency training.
• Direct patient care experience; attending-level experience is preferred.
• Extensive, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
• Strong clinical reasoning skills, including differential diagnosis, next-step management, and adherence to evidence-based guidelines.
• Proficient written English (C1+).
• Previous experience in medical AI evaluation, clinical content review, exam question review, or medical annotation/quality assurance is advantageous.
• Not appropriate for medical students, unlicensed medical graduates, non-physician clinicians, or non-clinical healthcare professionals.
• Earnings per approved task: a predetermined fixed rate for each task.
• Fully self-scheduled: no minimum hour requirements and no fixed schedule.
• Work remotely.
• No patient interactions and no malpractice risks.
• One-time onboarding bonus of $50, granted once your first task on the project is approved.
• Quality incentives: additional earnings for high-quality approved tasks.
• Flexible project participation with time limitations.
• No time tracking or hour logging required.
• No tiers or speed adjustments affecting the rate.
CVS Health Careers
Sourcegraph
MCA Connect
Lightly
Get handpicked remote jobs straight to your inbox weekly.