
Physician, Medical AI Evaluation
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in Alabama, +5 more states.
β’ Assess clinical EHR vignettes alongside questions, suggested answers, and misleading options related to diagnosis and treatment tasks.
β’ Address cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.
β’ Evaluate the quality of clinical reasoning, the accuracy and completeness of vignettes, the correctness and gradeability of answers, and the quality of distractors.
β’ Determine if the reasoning leads to the answer based solely on the facts presented in the vignette.
β’ Correct reasoning paths and compose brief rationales.
β’ Operate within three independent blind reviews, followed by adjudication by a physician.
β’ Complete tasks by specified deadlines and adhere to the established acceptance criteria.
β’ Must be a US-based, actively practicing physician with an MD or DO degree.
β’ Possess an active, unrestricted US medical license, verified by the issuing medical board.
β’ Must have board certification or have completed residency training.
β’ Recent experience in direct patient care is required; attending-level experience is preferred.
β’ Extensive multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
β’ Strong clinical reasoning skills, including differential diagnosis, next-step management, and the application of evidence-based guidelines.
β’ Experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is advantageous.
β’ Proficient written English (C1+ level).
β’ Required to submit a CV in English and indicate English proficiency level.
β’ This position is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare roles.
β’ Participation on a project basis.
β’ Part-time, non-permanent project opportunities.
β’ Flexible workload estimated at approximately 10β20 hours per week during active project phases.
β’ Compensation provided per accepted task.
β’ Rates can reach the equivalent of $100/hr, contingent on qualification tier and task efficiency.
Mindrift
Mindrift
ClickHouse
1mind
Get handpicked remote jobs straight to your inbox weekly.