Physician MD/DO – Put Medical AI to the Test

This is a fully remote position, open to applicants in United States.

📋 Description

• Assess written clinical EHR vignettes alongside associated questions, suggested answers, and distractor trap responses related to diagnosis and treatment tasks.

• Evaluate the quality of clinical reasoning, accuracy and completeness of vignettes, correctness and gradeability of answers, potential hints within the vignette, and quality of trap responses.

• Determine if reasoning pathways lead to answers based solely on facts presented in the vignette.

• Rectify reasoning pathways and compose brief rationales.

• Conduct three independent blind reads for each case followed by physician adjudication.

• Submit tasks via the platform and complete approved project work to enhance medical AI systems.

⛳️ Requirements

• A medical degree (MD or DO).

• An active, unrestricted US medical license, verified during onboarding and re-checked monthly.

• Board certification or completion of residency training.

• Experience in direct patient care; attending-level experience is preferred.

• Extensive multi-system diagnostic and treatment experience in internal medicine, family medicine, emergency medicine, or hospital medicine.

• Strong clinical reasoning skills, including expertise in differential diagnosis, next-step management, and adherence to evidence-based guidelines.

• Proficient written English (C1+ level).

• Experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is advantageous.

• Must be a physician licensed in the US.

• Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare titles.

🏝️ Benefits

• Compensation for each approved task at a predetermined fixed rate.

• Fully self-scheduled work without minimum hours or fixed schedules.

• Opportunity to work remotely.

• No patient interactions and no exposure to malpractice risks.

• A one-time onboarding bonus of $50 after the completion of the first approved task.

• Quality incentives for tasks that meet high-quality standards.

• Flexibility in task participation to accommodate other commitments.

• Increased per-task rates for QA and adjudication responsibilities.