Physician MD/DO – Medical AI Evaluation

This is a fully remote position, open to applicants in Romania, +5 more countries.

📋 Description

• Analyze clinical EHR vignettes, along with accompanying questions, suggested answers, and distractor options related to diagnosis and treatment tasks.

• Evaluate vignettes covering various systems including cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary.

• Assess the quality of clinical reasoning, the accuracy and completeness of vignettes, the correctness and gradeability of answers, and the quality of distractors.

• Verify that reasoning chains lead to answers based solely on the facts provided in the vignettes.

• Correct reasoning pathways and compose brief rationales.

• Conduct three independent blind reviews followed by adjudication by a physician.

• Engage in a project-based medical AI evaluation opportunity for prominent technology firms.

⛳️ Requirements

• Currently practicing physician residing outside the United States.

• Possession of a medical degree (MD or DO).

• Valid and unrestricted US medical license, verified at onboarding and re-verified monthly.

• Board certification or completion of residency training.

• Recent experience in direct patient care; attending-level experience is preferred.

• Extensive multi-system diagnostic and treatment experience in internal medicine, family medicine, emergency medicine, or hospital medicine.

• Strong clinical reasoning capabilities, including differential diagnosis, next-step management, and adherence to evidence-based guidelines.

• Previous experience in medical AI evaluation, clinical content review, exam-question review, or medical annotation/QA is an advantage.

• Proficient written English skills (C1+ level).

• CV must be submitted in English.

• Not applicable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare roles.

🏝️ Benefits

• Compensation per approved task at approximately $60/hr equivalent.

• Flexible contribution schedule; you can select when and how much to contribute.

• Ability to work from any location.

• No direct patient interaction.

• No exposure to malpractice risks.

• One-time onboarding reward of $50 following the approval of the first production task.

• Incentives for high-quality approved tasks.

• Quality assurance and adjudication tasks compensated at a higher rate.