
Licensed Physician, Freelance AI Trainer
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in Idaho, +4 more states.
• Evaluate clinical EHR vignettes alongside questions, proposed answers, and distractor trap answers related to diagnosis and treatment tasks.
• Assess cases covering cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.
• Score the quality of clinical reasoning, the accuracy and completeness of vignettes, the correctness and gradeability of answers, answer leakage, and the quality of traps.
• Verify if reasoning chains lead to answers based solely on vignette facts.
• Correct reasoning traces and compose brief rationales.
• Operate within three independent blind reads followed by physician adjudication.
• Complete approved tasks in accordance with project timelines and acceptance criteria.
• Medical degree (MD or DO).
• Active, unrestricted US medical license, verified at onboarding and re-checked monthly.
• Currently practicing as a physician.
• Board certification or completion of residency training.
• Recent direct patient care; attending-level experience preferred.
• Extensive, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
• Strong clinical reasoning abilities, including differential diagnosis, next-step management, and adherence to evidence-based guidelines.
• Proficiency in written English (C1+).
• Previous experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is advantageous.
• Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or non-clinical healthcare titles.
• Compensation per approved task, roughly equivalent to $100/hr; a single flat rate for each approved task.
• $50 one-time onboarding bonus, paid once your first production task is approved.
• Incentives: additional earnings for high-quality approved tasks.
• Flexible contribution schedule; determine when and how much to contribute.
• Opportunity to work from anywhere.
• No patient contact and no risk of malpractice exposure.
• Project-based, time-limited participation.
• QA and adjudication tasks compensated at a higher rate.
Atmosera
Cardinal Health
Mistral AI
Zoetis
Get handpicked remote jobs straight to your inbox weekly.