Physician Reviewer, MD/DO – Medical AI Evaluation

This is a fully remote position, open to applicants in Jordan, +3 more countries.

📋 Description

• Assess clinical EHR vignettes alongside questions, suggested answers, and misleading distractor options related to diagnosis and treatment tasks.

• Rate the accuracy and completeness of vignettes, the correctness and gradeability of answers, and evaluate if the vignette reveals the answer or the quality of the distractors.

• Determine whether reasoning chains derive answers solely from the facts presented in the vignettes.

• Rectify reasoning paths and compose brief rationales.

• Collaborate within three independent blind reviews followed by physician adjudication.

• Fulfill project responsibilities within the established timeline and specified acceptance criteria.

⛳️ Requirements

• Must be an actively practicing physician with an MD or DO degree.

• Possess an active, unrestricted medical license in the US, verified during onboarding and re-checked monthly.

• Reside outside the United States.

• Hold board certification or have completed residency training; attending-level experience is preferred.

• Have recent experience in direct patient care.

• Demonstrate broad, multi-system diagnostic and treatment expertise in internal medicine, family medicine, emergency medicine, or hospital medicine.

• Exhibit strong clinical reasoning skills, including differential diagnosis, next-step management, and application of evidence-based guidelines.

• Proficient in written English (C1+ level).

• Submit a CV in English, indicating your level of English proficiency.

• Not applicable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare roles.

🏝️ Benefits

• Estimated workload of about 10–20 hours per week while the project is ongoing; you have the flexibility to choose when and how much to contribute.

• Opportunity to contribute at any time, from any location.

• No direct patient contact, minimizing malpractice exposure.

• One-time onboarding reward of $50, payable once your first production task is approved.

• Additional earnings available for high-quality approved tasks as incentives.

• QA and adjudication tasks compensated at a higher rate.

• Participation is flexible, project-based, and time-limited.