
Physician Reviewer, MD/DO β Medical AI Evaluation
Posted 4 days ago

Posted 4 days ago
This is a fully remote position, open to applicants in Alabama, +5 more states.
β’ Evaluate clinical EHR scenarios alongside questions, suggested answers, and distractor options related to diagnosis and treatment tasks.
β’ Assess cases across various systems, including cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary.
β’ Score the quality of clinical reasoning, the accuracy and completeness of vignettes, the correctness and gradeability of answers, and the quality of distractors.
β’ Verify whether reasoning chains derive answers solely from the facts presented in the vignettes.
β’ Correct reasoning pathways and compose concise rationales.
β’ Engage in three independent blind evaluations followed by physician adjudication.
β’ Fulfill qualification tasks and submit approved project assignments via the platform.
β’ Medical degree (MD or DO) is required.
β’ Must possess an active, unrestricted US medical license, verified at onboarding and re-checked monthly.
β’ Board certification or completion of residency training is necessary.
β’ Experience in direct patient care; attending-level experience is preferred.
β’ Comprehensive diagnostic and treatment experience across multiple systems in internal, family, emergency, or hospital medicine.
β’ Strong clinical reasoning skills, including differential diagnosis, next-step management, and the application of evidence-based guidelines.
β’ Proficient written English skills (C1+ level).
β’ Previous experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/quality assurance is an advantage.
β’ Must be a US-licensed physician residing in an eligible US state.
β’ This position is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals holding non-clinical healthcare titles.
β’ Compensation per approved task at a predetermined fixed rate.
β’ Flexible work schedule allowing for self-scheduling with no minimum hours required.
β’ Opportunity for remote work.
β’ No patient interaction and no risk of malpractice exposure.
β’ One-time onboarding reward of $50, paid upon approval of the first task.
β’ Quality incentives for tasks that achieve high approval standards.
β’ Elevated per-task rates for quality assurance and adjudication assignments.
CVS Health
RWS Group
RWS Group
RWS Group
Get handpicked remote jobs straight to your inbox weekly.