
Physician MD/DO β Medical AI Evaluation
Posted 6 days ago

Posted 6 days ago
This is a fully remote position, open to applicants in United States.
β’ Evaluate clinical electronic health record (EHR) vignettes alongside corresponding questions, suggested answers, and distractor trap answers related to diagnosis and treatment tasks.
β’ Assess cases covering cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.
β’ Score the accuracy and completeness of vignettes, assess answer disclosure, correctness, gradeability, and trap quality.
β’ Verify whether reasoning chains derive answers solely from the facts presented in the vignettes.
β’ Correct reasoning pathways and compose concise rationales.
β’ Engage in a three-independent-blind-read process followed by a review from a physician.
β’ Complete qualification tasks and submit project tasks for approval through the designated platform.
β’ A medical degree (MD or DO) is required.
β’ Must possess an active, unrestricted US medical license, which will be verified during onboarding and re-checked every month.
β’ Board certification or completion of residency training is necessary.
β’ Direct patient care experience is essential; attending-level experience is preferred.
β’ Comprehensive multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine is required.
β’ Strong clinical reasoning skills, including differential diagnosis, next-step management, and adherence to evidence-based guidelines.
β’ Proficiency in written English (C1 or higher) is necessary.
β’ Previous experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/quality assurance is advantageous.
β’ This position is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or those with non-clinical healthcare titles.
β’ Fixed compensation for each approved task completed.
β’ Flexible work schedule with fully self-scheduled hours and no minimum time commitment.
β’ Remote work opportunity.
β’ No patient interaction or malpractice risk.
β’ A one-time onboarding reward of $50, payable once the first task is approved.
β’ Quality incentives for tasks that receive high-quality approval.
β’ Increased per-task rates for quality assurance and adjudication tasks.
CVS Health Careers
Sourcegraph
MCA Connect
Lightly
Get handpicked remote jobs straight to your inbox weekly.