
Licensed Physician, Freelance AI Trainer
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in Canada.
• Assess clinical EHR vignettes alongside corresponding questions, proposed answers, and distractor options from various medical systems.
• Evaluate the quality of clinical reasoning, accuracy and completeness of vignettes, correctness and gradeability of answers, and the quality of distractors.
• Determine if reasoning chains derive answers solely from the facts within the vignette.
• Correct reasoning pathways and compose brief rationales.
• Engage in a process that includes three independent blind evaluations followed by physician adjudication.
• Complete assignments via the platform and submit them for approval based on project acceptance criteria.
• Aid in the testing, evaluation, and enhancement of medical AI systems.
• Medical degree (MD or DO).
• Active, unrestricted US medical license, verified at the time of onboarding and re-validated monthly.
• Board certification or completion of residency training.
• Experience in direct patient care; attending-level experience is preferred.
• Extensive multi-system diagnostic and treatment experience in internal medicine, family medicine, emergency medicine, or hospital medicine.
• Excellent clinical reasoning skills, encompassing differential diagnosis, next-step management, and the application of evidence-based guidelines.
• Proficient written English skills (C1+ level).
• Previous experience in evaluating medical AI, reviewing clinical content or exam questions, or in medical annotation/QA is advantageous.
• This position is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or holders of non-clinical healthcare titles.
• A one-time onboarding reward of $50, payable upon approval of your first task on the project.
• Quality incentives that provide additional earnings for high-quality approved tasks, as outlined in the project guidelines.
• Complete flexibility in scheduling: no minimum hours and no fixed timetable.
• Opportunity for remote work.
• No direct patient contact, eliminating malpractice exposure.
• Flexible, time-limited project involvement.
• Compensation provided for completed and approved tasks.
• Higher payment rates for QA and adjudication tasks.
Atmosera
Cardinal Health
Mistral AI
Zoetis
Get handpicked remote jobs straight to your inbox weekly.