
Physician, Medical AI Evaluation
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in Texas.
• Analyze clinical EHR vignettes that include questions, suggested answers, and distractor “trap” options related to diagnosis and treatment tasks.
• Evaluate vignettes covering cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.
• Assess the quality of clinical reasoning, the accuracy and completeness of vignettes, the correctness and gradeability of answers, and the effectiveness of traps.
• Determine if reasoning chains derive answers solely from the facts presented in the vignettes.
• Correct reasoning paths and compose brief rationales.
• Engage in three independent blind reviews followed by physician adjudication.
• Complete tasks by specified deadlines and adhere to established acceptance criteria.
• Must be a US-based, actively practicing physician holding either an MD or DO.
• Possess an active, unrestricted US medical license, confirmed by the relevant medical board.
• Have board certification or have completed residency training.
• Recent experience in direct patient care; attending-level experience is preferred.
• Extensive experience in multi-system diagnostics and treatments in internal, family, emergency, or hospital medicine.
• Strong clinical reasoning skills, including the ability to perform differential diagnoses, next-step management, and apply evidence-based guidelines.
• Proficient written English skills (C1+ level).
• Previous experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is advantageous.
• Curriculum Vitae must be submitted in English.
• Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare roles.
• Participation is project-based.
• Opportunities available for part-time, non-permanent project work.
• Compensation can reach up to the equivalent of $100/hr, paid for each accepted task.
• Flexible workload is anticipated at 10–20 hours per week during active project phases.
Mindrift
Mindrift
ClickHouse
1mind
Get handpicked remote jobs straight to your inbox weekly.