
Licensed Physician MD/DO β Freelance AI Trainer
Posted 4 days ago

Posted 4 days ago
This is a fully remote position, open to applicants in Idaho, +4 more states.
β’ Evaluate clinical EHR vignettes alongside related questions, suggested answers, and distractor trap answers within diagnosis and treatment tasks.
β’ Review vignettes covering cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.
β’ Assess the quality of clinical reasoning, accuracy and completeness of vignettes, correctness and gradeability of answers, and quality of distractors.
β’ Determine if reasoning chains derive answers solely from facts present in the vignettes.
β’ Correct reasoning pathways and provide concise rationales.
β’ Complete three independent blind reviews followed by physician adjudication.
β’ Engage in a project-based AI evaluation program aimed at testing, assessing, and enhancing AI systems.
β’ Medical degree (MD or DO) required.
β’ Active and unrestricted US medical license, verified during onboarding and re-checked monthly.
β’ Must be an actively practicing physician.
β’ Board certification or completion of residency training is necessary.
β’ Recent experience in direct patient care; attending-level experience is preferred.
β’ Extensive, multi-system diagnostic and treatment experience in internal medicine, family medicine, emergency medicine, or hospital medicine.
β’ Strong clinical reasoning skills, including differential diagnosis, next-step management, and the application of evidence-based guidelines.
β’ Excellent written English proficiency (C1+ level).
β’ Experience in medical AI evaluation, clinical content review, exam-question review, or medical annotation/QA is advantageous.
β’ Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals holding non-clinical healthcare titles.
β’ Compensation is based on approved tasks at approximately $100/hour equivalent; a single flat rate is provided for each approved task.
β’ A one-time onboarding reward of $50, payable once your first production task is approved.
β’ Additional earnings for high-quality approved tasks as part of the incentives program.
β’ Flexible contribution schedule, allowing you to choose when and how much to contribute.
β’ Opportunity to work from any location.
β’ No patient contact and no risk of malpractice exposure.
β’ Project-based, time-limited work designed to complement your clinical practice.
CVS Health
RWS Group
RWS Group
RWS Group
Get handpicked remote jobs straight to your inbox weekly.