
Physician, MD/DO
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in Colorado.
• Assess clinical EHR vignettes alongside questions, suggested answers, and distractor trap answers related to diagnosis and treatment tasks.
• Evaluate the quality of clinical reasoning, accuracy and completeness of vignettes, correctness and gradability of answers, as well as the quality of trap answers.
• Determine if reasoning chains arrive at answers solely based on the facts presented in the vignettes.
• Rectify reasoning traces and compose brief rationales.
• Engage in three independent blind readings followed by adjudication by a physician.
• Fulfill flexible, task-based contributions via the platform.
• Complete designated tasks for a time-sensitive medical AI evaluation project.
• Medical degree (MD or DO) is required.
• An active, unrestricted US medical license, which will be verified during onboarding and re-checked monthly.
• Board certification or completion of residency training is necessary.
• Experience in direct patient care; attending-level experience is preferred.
• Comprehensive, multi-system diagnostic and treatment experience in internal medicine, family medicine, emergency medicine, or hospital medicine.
• Strong clinical reasoning skills, including differential diagnosis, next-step management, and the application of evidence-based guidelines.
• Proficient written English (C1+ level).
• Previous experience in medical AI evaluation, clinical content review, exam-question review, or medical annotation/QA is advantageous.
• This position is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or those with non-clinical healthcare titles.
• Fixed compensation for each approved task, established beforehand.
• Work is fully self-scheduled with no minimum hours or fixed schedule required.
• One-time onboarding reward of $50, payable once the first task in the project is approved.
• Quality incentives: additional earnings for high-quality approved tasks.
• No requirements for time tracking or hour logging.
• Increased per-task rate for QA and adjudication tasks.
Fireflies.ai
CVS Health Careers
CVS Health Careers
Get handpicked remote jobs straight to your inbox weekly.