
Physician MD/DO β Medical AI Evaluation
Posted 4 days ago

Posted 4 days ago
This is a fully remote position, open to applicants in Idaho, +4 more states.
β’ Assess clinical EHR vignettes that are accompanied by questions, proposed answers, and distractor trap answers related to diagnosis and treatment tasks.
β’ Evaluate the quality of clinical reasoning, the accuracy and completeness of vignettes, the correctness and gradeability of answers, and the quality of traps.
β’ Determine if reasoning chains lead to answers solely based on the facts presented in the vignettes.
β’ Correct reasoning pathways and compose brief rationales.
β’ Engage in three independent blind reviews followed by physician adjudication.
β’ Complete project assignments via the platform and receive compensation for approved tasks.
β’ A medical degree (MD or DO).
β’ An active, unrestricted US medical license, verified during onboarding and re-validated monthly.
β’ Board certification or completion of residency training.
β’ Experience in direct patient care; attending-level is preferred.
β’ Extensive multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
β’ Strong clinical reasoning skills, including differential diagnosis, next-step management, and the application of evidence-based guidelines.
β’ Proficient written English (C1+).
β’ A US-licensed physician residing in an eligible US state.
β’ Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or non-clinical healthcare professionals.
β’ Fixed compensation for each approved task, determined in advance.
β’ Completely self-scheduled with no minimum hours or predetermined schedule.
β’ Opportunity for remote work.
β’ No patient interaction and no risk of malpractice exposure.
β’ A one-time onboarding bonus of $50, payable once the first task is approved.
β’ Quality incentives for tasks that receive high approval ratings.
β’ Increased compensation per task for QA and adjudication roles.
CVS Health
RWS Group
RWS Group
RWS Group
Get handpicked remote jobs straight to your inbox weekly.