
Physician, Medical AI Evaluation
Posted Nov 13

Posted Nov 13
This is a fully remote position, open to applicants in United States.
β’ Assess clinical EHR vignettes along with questions, suggested answers, and distractor "trap" answers pertaining to diagnosis and treatment tasks.
β’ Evaluate the quality of clinical reasoning, accuracy and completeness of vignettes, correctness and gradeability of answers, and effectiveness of trap answers.
β’ Determine if reasoning chains derive answers solely from the facts presented in the vignettes.
β’ Correct reasoning pathways and provide concise rationales.
β’ Engage in three independent blind evaluations and physician adjudication processes.
β’ Execute project tasks via the platform and receive payment for approved tasks.
β’ Medical degree (MD or DO) is required.
β’ Must possess an active, unrestricted US medical license, verified at onboarding and re-verified monthly.
β’ Board certification or completion of residency training is necessary.
β’ Direct patient care experience is required; attending-level experience is preferred.
β’ Extensive multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine is essential.
β’ Strong clinical reasoning skills are required, including differential diagnosis, next-step management, and the application of evidence-based guidelines.
β’ Previous experience in medical AI evaluation, clinical content or exam question review, or medical annotation/quality assurance is advantageous.
β’ Proficient written English skills (C1+) are necessary.
β’ This position is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare titles.
β’ Compensation per approved task: a fixed rate for each task, determined in advance.
β’ Fully self-scheduled: no minimum hours required and no designated schedule.
β’ Work remotely.
β’ No patient interactions and no malpractice risk.
β’ One-time onboarding incentive of $50, payable once your first task on the project is approved.
β’ Quality incentives: additional earnings for high-quality approved tasks, as specified in the project guidelines.
β’ No time tracking or hour logging is necessary.
β’ No tiers or speed adjustments to the compensation rate.
β’ Higher compensation per task for quality assurance and adjudication tasks.
CVS Health Careers
Sourcegraph
MCA Connect
Lightly
Get handpicked remote jobs straight to your inbox weekly.