
Physician, Medical AI Evaluation
Posted 9 hours ago

Posted 9 hours ago
This is a fully remote position, open to applicants in United States.
β’ Analyze clinical EHR vignettes along with associated questions, suggested answers, and distractor βtrapβ answers related to diagnosis and treatment tasks.
β’ Evaluate cases that cover cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.
β’ Assess the quality of clinical reasoning, accuracy and completeness of vignettes, correctness and gradeability of answers, and quality of traps.
β’ Verify if reasoning chains derive answers solely from the facts presented in the vignettes.
β’ Correct reasoning pathways and compose brief rationales.
β’ Operate within three separate blind reads followed by physician adjudication.
β’ Dedicate approximately 10β20 hours weekly during active project phases.
β’ Submit tasks punctually and fulfill acceptance criteria.
β’ Must be a US-based, actively practicing physician.
β’ Possess a medical degree (MD or DO).
β’ Hold an active, unrestricted US medical license, confirmed by the issuing medical board.
β’ Obtain board certification or have completed residency training.
β’ Recent hands-on patient care experience; attending-level experience is preferred.
β’ Have broad, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
β’ Exhibit strong clinical reasoning skills, including differential diagnosis, next-step management, and the application of evidence-based guidelines.
β’ Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is advantageous.
β’ Proficient in written English (C1+).
β’ Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals holding non-clinical healthcare positions.
β’ Participation is project-based.
β’ Opportunities available for part-time, non-permanent projects.
β’ Compensation is provided per accepted task.
β’ Hourly rates can reach up to the equivalent of $60/hr, depending on qualification tier and task efficiency.
Creatio
Kyndryl
Tenpo
Mindrift
Get handpicked remote jobs straight to your inbox weekly.