
Physician Reviewer, MD/DO β Medical AI Evaluation
Posted Nov 13

Posted Nov 13
This is a fully remote position, open to applicants in Louisiana.
β’ Assess clinical EHR vignettes alongside corresponding questions, suggested answers, and distractor options related to diagnosis and treatment tasks.
β’ Evaluate the quality of clinical reasoning, accuracy and completeness of vignettes, correctness and gradeability of answers, and quality of distractors.
β’ Determine if reasoning leads to answers based solely on the facts presented in the vignette.
β’ Provide corrections for reasoning paths and compose brief rationales.
β’ Engage in three independent blind evaluations followed by adjudication by a physician.
β’ Fulfill qualification tasks and submit project assignments via the platform.
β’ Enhance medical AI evaluation systems for leading tech companies.
β’ Medical degree (MD or DO) required.
β’ Active and unrestricted US medical license, verified at onboarding and re-verified monthly.
β’ Board certification or completion of residency training is necessary.
β’ Experience in direct patient care; attending-level experience is preferred.
β’ Extensive diagnostic and treatment experience across multiple systems in internal, family, emergency, or hospital medicine.
β’ Strong clinical reasoning skills, including differential diagnosis, next-step management, and adherence to evidence-based guidelines.
β’ Proficient written English (C1+ level).
β’ Previous experience in medical AI evaluation, clinical content review, exam-question analysis, or medical annotation/QA is advantageous.
β’ Must be a US-licensed physician residing in an eligible US state.
β’ Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare roles.
β’ Earnings per approved task at a predetermined fixed rate.
β’ Flexible self-scheduling with no minimum hours or set timetable.
β’ Work remotely.
β’ No direct patient interaction or malpractice risk.
β’ One-time onboarding reward of $50, payable upon approval of the first task.
β’ Quality incentives: additional earnings for high-quality approved tasks.
β’ Increased per-task rates for QA and adjudication assignments.
CVS Health Careers
Sourcegraph
MCA Connect
Lightly
Get handpicked remote jobs straight to your inbox weekly.