
Physician Reviewer, MD/DO β Medical AI Evaluation
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in Alaska.
β’ Assess clinical EHR vignettes alongside relevant questions, suggested answers, and distractor trap answers related to diagnosis and treatment activities.
β’ Evaluate the quality of clinical reasoning, the accuracy and completeness of vignettes, correctness and gradeability of answers, as well as the quality of traps.
β’ Determine if reasoning chains derive answers solely from the facts presented in the vignettes.
β’ Correct reasoning pathways and compose concise rationales.
β’ Engage in three independent blind readings and physician adjudication.
β’ Fulfill qualification tasks and submit project-related tasks via the platform.
β’ Execute approved tasks on a self-scheduled, flexible basis.
β’ Medical degree (MD or DO).
β’ Active, unrestricted US medical license, verified during onboarding and re-verified monthly.
β’ Board certification or completion of residency training.
β’ Experience in direct patient care; attending-level experience is preferred.
β’ Extensive experience in multi-system diagnostics and treatments in internal medicine, family medicine, emergency medicine, or hospital medicine.
β’ Excellent clinical reasoning skills, including differential diagnosis, next-step management, and application of evidence-based guidelines.
β’ Proficiency in written English (C1+).
β’ Previous experience in medical AI evaluation, clinical content or exam question review, or medical annotation/QA is advantageous.
β’ Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare titles.
β’ $50 one-time onboarding bonus, paid after the approval of your first task on the project.
β’ Quality incentives: additional earnings for high-quality approved tasks, as outlined in the project guidelines.
β’ Fully self-scheduled: no minimum hours required and no set timetable.
β’ Flexible participation based on tasks.
β’ Work remotely.
β’ No patient contact and no exposure to malpractice.
β’ Project-based opportunity without an employment relationship.
Atmosera
Cardinal Health
Mistral AI
Zoetis
Get handpicked remote jobs straight to your inbox weekly.