Nurse Practitioner, SME – AI Evaluation

This is a fully remote position, open to applicants in Australia, +6 more countries.

📋 Description

• Assess the accuracy, completeness, clinical relevance, and consistency of AI-generated healthcare information with established medical knowledge and guidelines.

• Evaluate AI-generated clinical evaluations, differential diagnoses, and explanations related to treatment.

• Detect factual inaccuracies, unsupported claims, absent clinical considerations, and any potential safety issues for patients.

• Perform medical research and confirm information using peer-reviewed studies, clinical practice guidelines, and recognized healthcare resources.

• Analyze hypothetical patient cases, including symptoms, medical histories, lab results, and diagnostic information.

• Offer evidence-based feedback and suggest necessary corrections.

• Adhere to project-specific scoring rubrics, annotation guidelines, and quality assurance protocols.

• Complete assigned evaluations using designated online platforms, such as DataCompute.

• Ensure confidentiality and comply with privacy, ethical, and data security standards.

⛳️ Requirements

• Currently enrolled in the third or fourth year of an accredited medical degree program, an eligible medical internship or residency, or an advanced Nurse Practitioner or Physician Assistant educational program with relevant clinical training.

• Relevant academic coursework, clinical rotations, or supervised training in General Practice, Family Medicine, Internal Medicine, Nurse Practitioner practice, or Physician Assistant practice.

• Strong grasp of medical terminology, anatomy, physiology, pathology, pharmacology, and pertinent clinical concepts.

• Capability to evaluate medical scenarios, interpret clinical data, and differentiate evidence-based reasoning from incorrect or unsupported conclusions.

• Ability to research medical literature, interpret clinical guidelines, and confirm findings using authoritative healthcare sources.

• Strong analytical reasoning skills, problem-solving capabilities, and meticulous attention to detail.

• Excellent proficiency in written English.

• Comfort with computers, web-based platforms, digital documentation, and online research tools.

• Ability to follow detailed instructions, complete tasks independently, and meet quality standards.

• Willingness to engage in remote freelance work with assignments and schedules dependent on the project.

• Second-year medical students must be enrolled in a top-tier medical school.

• Third-year students and above are welcome from all qualifying programs.

• Previous experience in AI evaluation is not necessary.

• Independent medical licensure and prior employment as a licensed physician, Nurse Practitioner, or Physician Assistant are not required for eligible student-level assignments.

🏝️ Benefits

• Opportunity for supplemental income.

• Remote work from an eligible location.

• Flexible schedule with potential assignments on weekdays and weekends.

• Experience in AI evaluation, medical content assessment, and evidence-based research.

• Freelance project-based engagement.

• No prior AI experience needed.