Physician Reviewer, Medical AI Evaluation

This is a fully remote position, open to applicants in Texas.

📋 Description

• Assess clinical EHR vignettes alongside questions, suggested answers, and misleading trap answers related to diagnosis and treatment tasks.

• Evaluate the clinical reasoning quality of benchmark items, focusing on vignette accuracy and completeness, answer clarity, correctness, gradeability, and the quality of traps.

• Verify if reasoning chains derive answers solely from the facts presented in the vignette.

• Correct reasoning pathways and draft concise rationales.

• Engage in three independent blind reviews and physician adjudication.

• Execute project tasks through the designated platform.

• Successfully pass qualifications, join the project, complete authorized tasks, and receive compensation.

⛳️ Requirements

• Medical degree (MD or DO) is required.

• Must hold an active, unrestricted US medical license, which will be verified during onboarding and checked monthly thereafter.

• Board certification or completion of residency training is necessary.

• Experience in direct patient care is essential; attending-level experience is preferred.

• Comprehensive diagnostic and treatment experience across multiple systems in internal, family, emergency, or hospital medicine.

• Exceptional clinical reasoning skills, including differential diagnosis, next-step management, and utilization of evidence-based guidelines.

• Proficient written English skills (C1+ level).

• Prior experience in medical AI evaluation, clinical content review, exam-question analysis, or medical annotation/QA is advantageous.

• Must be a US-licensed physician residing in an eligible US state.

• This position is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare roles.

🏝️ Benefits

• One-time onboarding reward of $50, payable once your initial task on the project is approved.

• Quality incentives: potential for additional earnings for highly-rated approved tasks, as outlined in the project guidelines.

• Fully self-scheduled work: no minimum hour requirements and no predetermined schedule.

• Participation in a flexible, time-limited project.

• Opportunity for remote work.

• No patient interaction and no risk of malpractice exposure.

• Earnings are provided for tasks that are completed and approved.

• Higher per-task rates for quality assurance and adjudication tasks.