Physician Reviewer, Medical AI Evaluation

This is a fully remote position, open to applicants in Mexico, +5 more countries.

📋 Description

• Assess clinical EHR vignettes accompanied by questions, suggested answers, and distractor trap answers related to diagnosis and treatment tasks.

• Evaluate the quality of clinical reasoning, the accuracy and completeness of vignettes, the correctness and gradeability of answers, and the quality of trap answers.

• Determine if reasoning chains arrive at answers based solely on facts presented in the vignettes.

• Correct reasoning pathways and provide concise rationales.

• Operate within three independent blind readings, followed by physician adjudication.

• Fulfill qualifications, engage in a project, complete assigned tasks, and submit them within specified project timelines and acceptance criteria.

⛳️ Requirements

• Actively practicing physician residing outside the United States.

• Medical degree (MD or DO).

• An active, unrestricted US medical license, confirmed during onboarding and re-verified monthly.

• Board certification or completion of residency training.

• Recent experience in direct patient care; attending-level experience preferred.

• Extensive multi-system diagnostic and treatment knowledge in internal, family, emergency, or hospital medicine.

• Strong clinical reasoning skills, including differential diagnosis, next-step management, and the application of evidence-based guidelines.

• Proficient written English (C1+ level).

• Previous experience in medical AI evaluation, clinical content or exam question review, or medical annotation/QA is advantageous.

• Submit CV in English and specify English proficiency.

• Applicants must not be medical students, unlicensed medical graduates, non-physician clinicians, or non-clinical healthcare professionals.

🏝️ Benefits

• Compensation based on approved tasks, approximately $60/hour equivalent.

• Flexible contribution schedule and amounts tailored to accommodate clinical practice.

• Opportunity to contribute at any time, from any location.

• No patient interactions required.

• No exposure to malpractice risks.

• One-time onboarding reward of $50, paid after the approval of your first production task.

• Participation is project-based.

• QA and adjudication tasks compensated at a higher rate.

• Additional earnings opportunities for high-quality approved tasks.