
Physician Reviewer, Medical AI Evaluation
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in United States.
• Assess clinical EHR vignettes alongside questions, suggested answers, and misleading alternative answers related to diagnosis and treatment tasks.
• Evaluate benchmark items for vignette precision and thoroughness, answer transparency, answer validity and gradeability, as well as the quality of misleading options.
• Verify if reasoning sequences derive answers solely from vignette details.
• Rectify reasoning paths and compose concise explanations.
• Engage in three independent blind evaluations followed by physician review.
• Fulfill qualification requirements, join the project, submit tasks via the platform, and complete authorized project responsibilities.
• Medical degree (MD or DO).
• Active, unrestricted US medical license, confirmed during onboarding and reviewed monthly.
• Board certification or completion of residency training.
• Experience in direct patient care; attending-level is preferred.
• Extensive multi-system diagnostic and treatment experience within internal, family, emergency, or hospital medicine.
• Excellent clinical reasoning skills, including differential diagnosis, next-step management, and adherence to evidence-based guidelines.
• Strong proficiency in written English (C1+).
• Previous experience in medical AI evaluation, clinical content or exam-question analysis, or medical annotation/quality assurance is a plus.
• Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare roles.
• Fixed compensation for each approved task, established in advance.
• Completely self-scheduled with no minimum hour requirements or fixed timetable.
• Opportunity for remote work.
• No patient interaction and no risk of malpractice exposure.
• One-time onboarding reward of $50, payable after the first task is approved.
• Quality incentives: additional earnings for high-quality approved tasks.
• Increased per-task rate for quality assurance and adjudication tasks.
Mindrift
Mindrift
Mindrift
Mindrift
Get handpicked remote jobs straight to your inbox weekly.