
Physician, MD/DO β Medical AI Evaluation
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in Utah.
β’ Assess clinical EHR vignettes alongside questions, suggested answers, and misleading distractor options related to diagnosis and treatment tasks.
β’ Evaluate the quality of clinical reasoning, accuracy, completeness of vignettes, correctness and gradeability of answers, as well as the quality of distractors.
β’ Determine if reasoning pathways lead to answers solely based on the facts presented in the vignettes.
β’ Revise reasoning paths and compose brief rationales.
β’ Engage in three independent blind evaluations followed by adjudication by a physician.
β’ Fulfill project duties within the designated timeline and meet specified acceptance criteria.
β’ Medical degree (MD or DO) is required.
β’ Must hold an active, unrestricted US medical license, which will be verified during onboarding and checked monthly thereafter.
β’ Must be an actively practicing physician.
β’ Board certification or completion of residency training is necessary.
β’ Recent hands-on patient care experience is required.
β’ Preference will be given to candidates with attending-level experience.
β’ Extensive, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine is essential.
β’ Strong clinical reasoning skills, including proficiency in differential diagnosis, next-step management, and the application of evidence-based guidelines, are crucial.
β’ Excellent written English skills (C1+) are required.
β’ Experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is a plus.
β’ This position is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare titles.
β’ Flexible schedule; you can decide when and how much you want to contribute.
β’ Work remotely from any location.
β’ No direct patient interaction.
β’ No risk of malpractice exposure.
β’ Receive a one-time onboarding reward of $50, paid once your first production task is approved.
β’ Incentives are offered for additional earnings based on high-quality approved tasks.
β’ QA and adjudication tasks are compensated at a higher rate.
Girl Effect
Miratech
Miratech
iTalent PLUS
Get handpicked remote jobs straight to your inbox weekly.