Physician, MD/DO – Put Medical AI to the Test

This is a fully remote position, open to applicants in Alabama, +5 more states.

📋 Description

• Analyze clinical EHR vignettes alongside questions, suggested answers, and misleading trap answers.

• Evaluate diagnosis and treatment assignments across cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.

• Assess the quality of clinical reasoning, the accuracy and completeness of vignettes, the correctness and gradeability of answers, and the quality of trap answers.

• Determine if reasoning chains lead to answers based solely on the facts presented in the vignettes.

• Refine reasoning paths and compose concise rationales.

• Engage in three independent blind evaluations and participate in physician adjudication.

• Fulfill qualifications, join the project, submit tasks through the designated platform, and receive payment for approved submissions.

⛳️ Requirements

• Medical degree (MD or DO) is required.

• Active, unrestricted US medical license, verified at onboarding and re-evaluated monthly.

• Board certification or completion of residency training is mandatory.

• Experience in direct patient care; preference for attending-level physicians.

• Extensive diagnostic and treatment experience across multiple systems in internal, family, emergency, or hospital medicine.

• Strong clinical reasoning abilities, including differential diagnosis, management of next steps, and adherence to evidence-based guidelines.

• Proficient written English skills (C1+ level).

• Previous involvement in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is advantageous.

• Must hold US physician licensure; the project is restricted to eligible states within the US.

• Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare titles.

🏝️ Benefits

• Compensation per approved task: a fixed rate established beforehand.

• Completely self-scheduled with no minimum hours or specific timetable required.

• Opportunity for remote work.

• No patient interaction and no exposure to malpractice claims.

• One-time onboarding bonus of $50, disbursed upon approval of the first task.

• Quality incentives: additional earnings for tasks approved with high quality.

• Flexible participation in a time-limited project.