
Physician Reviewer, Medical AI Evaluation
Posted 16 hours ago

Posted 16 hours ago
This is a fully remote position, open to applicants in Virginia, +1 more state.
• Assess clinical EHR vignettes along with associated questions, suggested answers, and misleading distractor answers related to diagnosis and treatment tasks.
• Evaluate benchmark items for the accuracy and completeness of vignettes, answer disclosure, correctness of answers, gradeability, and quality of traps.
• Verify if reasoning chains derive answers solely from the facts presented in the vignettes.
• Rectify reasoning paths and compose concise rationales.
• Operate within three separate blind reads followed by a physician adjudication process.
• Assist in the testing, evaluation, and enhancement of medical AI systems for prominent technology firms.
• Must be a US-based, actively practicing physician (MD or DO).
• Possess a medical degree (MD or DO).
• Hold an active, unrestricted US medical license, verified by the issuing medical board.
• Board certified or have completed residency training.
• Recent direct patient care experience; attending-level preferred.
• Extensive, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
• Strong clinical reasoning skills, including differential diagnosis, next-step management, and the application of evidence-based guidelines.
• Proficient written English skills (C1+).
• Ability to submit tasks by deadlines and meet specified acceptance criteria.
• Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals holding non-clinical healthcare titles.
• Flexible part-time, non-permanent, project-based work.
• Compensation per accepted task.
• Potential earnings up to the equivalent of $100/hr based on qualification tier and task efficiency.
Mindrift
Mindrift
Mindrift
Mindrift
Get handpicked remote jobs straight to your inbox weekly.