
Physician, Medical AI Evaluation
Posted 6 hours ago

Posted 6 hours ago
This is a fully remote position, open to applicants in Alabama, +5 more states.
• Assess clinical EHR vignettes along with associated questions, proposed answers, and misleading distractor options related to diagnosis and treatment tasks.
• Evaluate the quality of clinical reasoning, the accuracy and completeness of vignettes, the correctness and gradeability of answers, and the quality of distractors.
• Determine if reasoning chains derive answers solely from the facts presented in the vignettes.
• Correct reasoning pathways and compose brief rationales.
• Operate within three independent blind reviews followed by physician adjudication.
• Fulfill project assignments within the established timeline and specified acceptance criteria.
• Medical degree (MD or DO) required.
• Must possess an active, unrestricted US medical license, verified during onboarding and re-verified monthly.
• Board certification or completion of residency training is necessary.
• Recent hands-on patient care experience; attending-level experience preferred.
• Extensive multi-system diagnostic and treatment experience in fields such as internal medicine, family medicine, emergency medicine, or hospital medicine.
• Strong clinical reasoning skills, including differential diagnosis, management of next steps, and application of evidence-based guidelines.
• Previous experience with medical AI evaluation, review of clinical content or exam questions, or medical annotation/QA is advantageous.
• Proficient written English skills (C1+ level).
• Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or non-clinical healthcare professionals.
• Approximately 10–20 hours per week while the project is ongoing; flexibility in choosing when and how much to work.
• Opportunity to contribute from any location at any time.
• No direct patient interaction involved.
• No risk of malpractice exposure.
• $50 one-time onboarding reward, payable once your initial production task is approved.
• QA and adjudication tasks are compensated at a higher rate.
• Incentives available: additional earnings for high-quality tasks that receive approval.
Mindrift
ClickHouse
1mind
Get handpicked remote jobs straight to your inbox weekly.