Physician, MD/DO – Medical AI Evaluation

This is a fully remote position, open to applicants in Mexico, +5 more countries.

📋 Description

• Assess clinical EHR vignettes that are accompanied by questions, suggested answers, and distractor trap answers.

• Review diagnosis and treatment assignments across various systems including cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary.

• Evaluate vignette accuracy, completeness, answer disclosure, answer correctness, gradeability, and quality of traps.

• Determine if reasoning chains derive answers solely from vignette facts.

• Revise reasoning traces and compose brief rationales.

• Engage in three independent blind reads followed by physician adjudication.

• Fulfill project tasks within specified timelines and acceptance criteria.

⛳️ Requirements

• Must be an actively practicing physician holding an MD or DO medical degree.

• Possess an active, unrestricted US medical license, verified during onboarding and re-checked on a monthly basis.

• Reside outside the United States.

• Hold board certification or have completed residency training.

• Have recent direct patient care experience, preferably at the attending level.

• Exhibit extensive multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.

• Demonstrate strong clinical reasoning skills, including differential diagnosis, next-step management, and adherence to evidence-based guidelines.

• Possess strong written English skills (C1+ level).

• Submit CV in English.

• Must successfully pass qualification(s).

• Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare titles.

🏝️ Benefits

• Compensation per approved task at an approximate rate of $60/hr equivalent flat rate.

• Flexible contribution schedule and workload.

• Opportunity to work remotely from any location.

• No patient interactions involved.

• No risk of malpractice exposure.

• One-time onboarding reward of $50 after the first production task is approved.

• Increased rate for QA and adjudication tasks.

• Incentives available for high-quality approved tasks.