Healthcare Subject Matter Expert – AI Model Evaluation

This is a fully remote position, open to applicants in United States, +6 more countries.

📋 Description

• Assess the factual accuracy, completeness, clinical relevance, and adherence to established medical knowledge and guidelines of AI-generated healthcare information.

• Evaluate AI-generated clinical assessments, differential diagnoses, and treatment-related explanations.

• Identify factual inaccuracies, unsupported assumptions, missing clinical considerations, and potential patient safety issues.

• Conduct medical research and validate information utilizing peer-reviewed literature, clinical practice guidelines, and established healthcare resources.

• Analyze hypothetical patient cases, including symptoms, medical histories, laboratory results, and diagnostic data.

• Provide evidence-based feedback and suggest appropriate corrections.

• Adhere to project-specific scoring rubrics, annotation instructions, and quality assurance protocols.

• Complete independent evaluation tasks using specified online platforms, including DataCompute.

• Meet established deadlines and quality standards.

• Uphold confidentiality and comply with privacy, ethical, and data security regulations.

⛳️ Requirements

• Currently enrolled in the third or fourth year of an accredited medical degree program, an eligible medical internship or residency, or an advanced NP or PA educational program with relevant clinical training.

• Relevant academic coursework, clinical rotations, or supervised training in General Practice, Family Medicine, Internal Medicine, Nurse Practitioner practice, or Physician Assistant practice.

• Strong knowledge of medical terminology, anatomy, physiology, pathology, pharmacology, and pertinent clinical concepts.

• Ability to evaluate medical scenarios, interpret clinical information, and differentiate evidence-based reasoning from inaccurate or unsupported conclusions.

• Capability to research medical literature, interpret clinical guidelines, and validate findings using authoritative healthcare resources.

• Strong analytical reasoning, problem-solving skills, and meticulous attention to detail.

• Excellent written communication skills in English.

• Proficiency in using computers, web-based platforms, digital documentation, and online research tools.

• Ability to follow detailed instructions, complete tasks independently, and meet quality expectations.

• Willingness to engage in a remote, freelance position with assignments and schedules determined by project needs.

• Second-year medical students must be enrolled in a leading medical school.

• Relevant specialty or study track is required.

• Independent medical licensure and prior experience as a licensed physician, Nurse Practitioner, or Physician Assistant are not required for eligible student-level evaluation tasks.

• Previous experience with AI is not necessary.

• Qualified candidates may need to complete an assessment of medical knowledge or clinical reasoning.

🏝️ Benefits

• Hourly compensation based on project work.

• Ability to work remotely from an eligible location.

• Flexible and variable schedule with potential assignments on weekdays and weekends.

• Exposure to AI evaluation, medical content assessment, and evidence-based research.

• Opportunity to leverage medical education in the context of emerging healthcare technology.

• Assignments distributed based on project needs and individual availability.