
Physician, Medical AI Evaluation
Posted 4 days ago

Posted 4 days ago
This is a fully remote position, open to applicants in Alabama, +5 more states.
β’ Analyze clinical EHR vignettes alongside corresponding questions, suggested answers, and distractor options related to diagnosis and treatment tasks.
β’ Evaluate cases that encompass the cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.
β’ Assess the accuracy and completeness of vignettes, answer disclosure, correctness and gradeability of answers, as well as the quality of distractors.
β’ Verify if reasoning chains lead to answers based solely on the facts presented in the vignette.
β’ Correct reasoning pathways and compose brief rationales.
β’ Engage in three independent blind evaluations followed by physician adjudication.
β’ Perform tasks via the platform and receive payment for tasks that are approved.
β’ Medical degree (MD or DO).
β’ Active and unrestricted US medical license, verified during onboarding and re-checked each month.
β’ Board certification or completion of residency training.
β’ Experience in direct patient care; attending-level experience is preferred.
β’ Extensive multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
β’ Strong clinical reasoning skills, including differential diagnosis, next-step management, and adherence to evidence-based guidelines.
β’ Proficient written English (C1+ level).
β’ Previous experience in medical AI evaluation, clinical content or exam question review, or medical annotation/QA is a plus.
β’ Must be a US-licensed physician residing in an eligible US state.
β’ Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or non-clinical healthcare professionals.
β’ Earnings per approved task at a predetermined fixed rate.
β’ One-time onboarding bonus of $50, paid once the first task is approved.
β’ Quality incentives: additional earnings for tasks of high quality that are approved.
β’ Completely self-scheduled with no minimum hour requirements or established timetable.
β’ Remote work opportunity.
β’ No patient interaction and no risk of malpractice exposure.
β’ Task-based independent contractor role.
β’ Flexible participation that accommodates other commitments.
CVS Health
RWS Group
RWS Group
RWS Group
Get handpicked remote jobs straight to your inbox weekly.