
Physician Reviewer, MD/DO β Medical AI Evaluation
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in Alabama, +5 more states.
β’ Assess clinical EHR vignettes alongside accompanying questions, proposed responses, and misleading trap answers related to diagnosis and treatment tasks.
β’ Analyze cases across various systems including cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary.
β’ Evaluate the quality of clinical reasoning, the accuracy and completeness of vignettes, the correctness and gradeability of answers, and the quality of traps.
β’ Determine if reasoning chains derive answers solely from the facts presented in the vignettes.
β’ Adjust reasoning pathways and compose brief rationales.
β’ Operate within a framework of three independent blind reviews followed by physician adjudication.
β’ Fulfill project tasks during active phases, estimated to require 10β20 hours weekly.
β’ Must be a US-based, actively practicing physician (MD/DO).
β’ Possession of a medical degree (MD or DO).
β’ Hold an active, unrestricted US medical license, validated by the issuing medical board.
β’ Must be board certified or have completed residency training.
β’ Recent direct patient care experience; attending-level preferred.
β’ Extensive multi-system diagnostic and treatment experience in internal medicine, family medicine, emergency medicine, or hospital medicine.
β’ Strong clinical reasoning skills, encompassing differential diagnosis, next-step management, and the application of evidence-based guidelines.
β’ Previous experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is advantageous.
β’ Proficient written English (C1+ level).
β’ This position is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or individuals with non-clinical healthcare titles.
β’ All tasks must be completed by specified deadlines and adhere to the outlined acceptance criteria.
β’ Participation is project-based.
β’ Opportunities for part-time, non-permanent projects.
β’ Compensation is provided per accepted task.
β’ Earnings can reach up to the equivalent of $100/hour, contingent upon qualification tier and task efficiency.
Mindrift
Mindrift
ClickHouse
1mind
Get handpicked remote jobs straight to your inbox weekly.