Healthcare Subject Matter Expert – AI Model Evaluation

This is a fully remote position, open to applicants in Canada, +6 more countries.

📋 Description

• Assess AI-generated healthcare information for accuracy, thoroughness, clinical relevance, and alignment with medical standards and guidelines.

• Review AI-produced evaluations, differential diagnoses, and treatment explanations.

• Detect factual inaccuracies, unsupported assumptions, overlooked clinical factors, and possible patient safety issues.

• Confirm information through peer-reviewed medical literature, clinical practice guidelines, and recognized healthcare resources.

• Analyze theoretical patient scenarios, symptoms, medical histories, laboratory results, and diagnostic data.

• Deliver evidence-based feedback and suggest necessary corrections.

• Adhere to project-specific scoring criteria, annotation guidelines, and quality assurance standards.

• Carry out independent evaluation tasks using designated online tools, including DataCompute.

• Fulfill established deadlines and quality benchmarks.

• Safeguard sensitive project information while adhering to privacy, ethical, and data security protocols.

⛳️ Requirements

• Currently enrolled in the third or fourth year of an accredited medical degree program, an eligible medical internship or residency, or an advanced NP or PA educational program with applicable clinical training.

• Relevant academic coursework, clinical rotations, or supervised training in General Practice, Family Medicine, Internal Medicine, Nurse Practitioner practice, or Physician Assistant practice.

• Second-year medical students must be attending a highly ranked medical school.

• Strong understanding of medical terminology, anatomy, physiology, pathology, pharmacology, and pertinent clinical concepts.

• Capability to evaluate medical situations, interpret clinical data, and differentiate evidence-based reasoning from inaccurate or unfounded conclusions.

• Proficiency in researching medical literature, interpreting clinical guidelines, and verifying findings using authoritative healthcare resources.

• Strong analytical reasoning, problem-solving skills, and meticulous attention to detail.

• Excellent written English proficiency.

• Comfortable using computers, web-based platforms, digital documentation, and online research tools.

• Ability to follow precise instructions, complete tasks independently, and meet quality standards.

• Willingness to engage in a remote, freelance capacity with project-dependent tasks and schedules.

• Independent medical licensure and prior experience as a licensed physician, Nurse Practitioner, or Physician Assistant are not mandatory.

• Qualified candidates may need to complete an assessment of medical knowledge or clinical reasoning.

🏝️ Benefits

• Compensation based on hourly project rates.

• Work remotely from an eligible location.

• Flexible and variable scheduling with potential assignments on weekdays and weekends.

• Gain exposure to AI evaluation, medical content assessment, and evidence-based research.

• Opportunity to apply medical education and clinical reasoning skills to healthcare AI initiatives.