
Physician Reviewer, MD/DO β Medical AI Evaluation
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in Tennessee.
β’ Assess clinical EHR vignettes alongside associated questions, suggested answers, and distractor answers related to diagnosis and treatment tasks.
β’ Evaluate the quality of clinical reasoning, the accuracy and completeness of vignettes, the correctness and gradeability of answers, and the quality of distractors.
β’ Determine if reasoning chains derive answers using only facts from the vignettes.
β’ Rectify reasoning pathways and compose brief rationales.
β’ Engage in three independent blind evaluations and physician adjudications.
β’ Fulfill project tasks via the platform and receive compensation for tasks that are approved.
β’ Medical degree (MD or DO).
β’ Valid, unrestricted US medical license, confirmed during onboarding and re-verified monthly.
β’ Board certification or completion of residency training.
β’ Experience in direct patient care; attending-level experience preferred.
β’ Extensive multi-system diagnostic and treatment experience in internal medicine, family medicine, emergency medicine, or hospital medicine.
β’ Strong clinical reasoning skills, including differential diagnosis, next-step management, and the application of evidence-based guidelines.
β’ Proficient written English (C1+).
β’ Experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is advantageous.
β’ Not applicable for medical students, unlicensed medical graduates, non-physician clinicians, or non-clinical healthcare roles.
β’ Compensation for each approved task: a predetermined fixed rate established beforehand.
β’ Fully self-scheduled: no minimum hours required and no fixed schedule; you have the flexibility to choose which tasks to undertake and when.
β’ Work remotely.
β’ No patient interaction and no exposure to malpractice risks.
β’ One-time onboarding bonus of $50, disbursed once your initial task on the project is approved.
β’ Quality incentives: additional earnings for high-quality approved tasks, as outlined in the project guidelines.
β’ No time tracking or hour logging required.
Atmosera
Cardinal Health
Mistral AI
Zoetis
Get handpicked remote jobs straight to your inbox weekly.