Healthcare Subject Matter Expert – AI Model Evaluation

This is a fully remote position, open to applicants in Australia, +6 more countries.

📋 Description

• Evaluate AI-generated healthcare information for accuracy, completeness, clinical relevance, and alignment with established medical knowledge and guidelines.

• Review AI-generated clinical assessments, differential diagnoses, and explanations related to treatment.

• Detect factual inaccuracies, unsupported assumptions, omitted clinical considerations, and potential risks to patient safety.

• Conduct medical research and authenticate information through peer-reviewed literature, clinical practice guidelines, and recognized healthcare resources.

• Analyze hypothetical patient scenarios, including symptoms, medical histories, laboratory results, and diagnostic data.

• Offer evidence-based feedback and suggest necessary corrections.

• Adhere to project-specific scoring rubrics, annotation instructions, and quality assurance protocols.

• Complete independent evaluation tasks using designated online platforms, such as DataCompute.

• Meet specified deadlines and uphold quality standards.

• Ensure confidentiality and comply with privacy, ethical, and data security regulations.

⛳️ Requirements

• Currently enrolled in the third or fourth year of an accredited medical degree program, a qualifying medical internship or residency, or an advanced NP or PA educational program with relevant clinical training.

• Relevant academic coursework, clinical rotations, or supervised training in General Practice, Family Medicine, Internal Medicine, Nurse Practitioner practice, or Physician Assistant practice.

• Strong grasp of medical terminology, anatomy, physiology, pathology, pharmacology, and pertinent clinical concepts.

• Capability to assess medical scenarios, interpret clinical information, and differentiate evidence-based reasoning from erroneous or unsupported conclusions.

• Proficient in researching medical literature, interpreting clinical guidelines, and validating findings using authoritative healthcare resources.

• Strong analytical skills, problem-solving capabilities, and meticulous attention to detail.

• Excellent written English proficiency.

• Comfortable with computers, web-based platforms, digital documentation, and online research tools.

• Ability to adhere to detailed instructions, complete tasks independently, and meet quality expectations.

• Willingness to engage in a remote, freelance capacity with project-based assignments and schedules.

• Second-year medical students must be enrolled at a leading medical school.

• Relevant specialty or study track is required.

• Independent medical licensure and prior experience as a licensed physician, Nurse Practitioner, or Physician Assistant are not necessary for eligible student-level roles.

🏝️ Benefits

• Remote work from an eligible location.

• Exposure to AI evaluation, medical content assessment, and evidence-based research.

• Opportunity to apply medical education and clinical reasoning to healthcare AI projects.

• Flexible scheduling, including potential weekday and weekend assignments.

• Project-based freelance engagement.

• No prior AI experience necessary.