
Physician, Medical AI Evaluation
Posted 6 days ago

Posted 6 days ago
This is a fully remote position, open to applicants in Philippines.
• Assess clinical EHR vignettes alongside related questions, suggested answers, and distractor options pertaining to diagnosis and treatment tasks.
• Evaluate the quality of clinical reasoning, accuracy and completeness of vignettes, correctness and gradeability of answers, and quality of traps.
• Determine if reasoning paths lead to answers based solely on the facts presented in the vignettes.
• Rectify reasoning traces and compose brief rationales.
• Engage in three independent blind readings and physician adjudication.
• Accomplish project qualification and approved tasks via the platform.
• Select which tasks to undertake and the timing for their completion.
• Medical degree (MD or DO) required.
• Must possess an active, unrestricted US medical license, verified at onboarding and re-checked monthly.
• Board certification or completion of residency training is necessary.
• Experience in direct patient care; attending-level experience is preferred.
• Extensive, multi-system diagnostic and treatment proficiency in internal, family, emergency, or hospital medicine.
• Excellent clinical reasoning skills, encompassing differential diagnosis, next-step management, and application of evidence-based guidelines.
• Proficient written English skills (C1+ level).
• Previous experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is advantageous.
• This position is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals holding non-clinical healthcare titles.
• One-time onboarding reward of $50, payable once your initial task on the project is approved.
• Quality incentives: additional earnings for high-quality approved tasks, as outlined in the project guidelines.
• Completely self-scheduled: no minimum hours required and no fixed schedule.
• Opportunity for remote work.
• Flexible participation in time-limited projects.
• No time tracking or hour logging required.
RWS Group
Stripe
Mindrift
Mindrift
Get handpicked remote jobs straight to your inbox weekly.