Physician, Medical AI Evaluation

Posted 6 hours ago

This is a fully remote position, open to applicants in Alabama, +5 more states.

📋 Description

• Assess clinical EHR vignettes along with associated questions, proposed answers, and misleading distractor options related to diagnosis and treatment tasks.

• Evaluate the quality of clinical reasoning, the accuracy and completeness of vignettes, the correctness and gradeability of answers, and the quality of distractors.

• Determine if reasoning chains derive answers solely from the facts presented in the vignettes.

• Correct reasoning pathways and compose brief rationales.

• Operate within three independent blind reviews followed by physician adjudication.

• Fulfill project assignments within the established timeline and specified acceptance criteria.


⛳️ Requirements

• Medical degree (MD or DO) required.

• Must possess an active, unrestricted US medical license, verified during onboarding and re-verified monthly.

• Board certification or completion of residency training is necessary.

• Recent hands-on patient care experience; attending-level experience preferred.

• Extensive multi-system diagnostic and treatment experience in fields such as internal medicine, family medicine, emergency medicine, or hospital medicine.

• Strong clinical reasoning skills, including differential diagnosis, management of next steps, and application of evidence-based guidelines.

• Previous experience with medical AI evaluation, review of clinical content or exam questions, or medical annotation/QA is advantageous.

• Proficient written English skills (C1+ level).

• Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or non-clinical healthcare professionals.


🏝️ Benefits

• Approximately 10–20 hours per week while the project is ongoing; flexibility in choosing when and how much to work.

• Opportunity to contribute from any location at any time.

• No direct patient interaction involved.

• No risk of malpractice exposure.

• $50 one-time onboarding reward, payable once your initial production task is approved.

• QA and adjudication tasks are compensated at a higher rate.

• Incentives available: additional earnings for high-quality tasks that receive approval.

People also viewed

Mindrift6 hours ago

Physician Reviewer, MD/DO – Medical AI Evaluation

RO flagRomania, +5 more countriesPart-timeArtificial Intelligence$60/hour
ApplyView job
ClickHouse7 hours ago

AI Operations Engineer

US flagUnited States OnlyFull-timeArtificial Intelligence$110k – $165k/year
ApplyView job
1mind7 hours ago

AI Conversation Designer

US flagUnited States OnlyFull-timeArtificial Intelligence$100k – $150k/year
ApplyView job
Tucuvi8 hours ago

Conversation AI Manager

ES flagSpain OnlyFull-timeArtificial Intelligence
ApplyView job
Human Agency8 hours ago

Director – AI Transformation

US flagUnited States, +1 more countryFull-timeArtificial Intelligence
ApplyView job
Birdie HR8 hours ago

Conversational AI Specialist

US flagUnited States OnlyFull-timeArtificial Intelligence
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers