Healthcare Subject Matter Expert – AI Model Evaluation

This is a fully remote position, open to applicants in New Zealand, +6 more countries.

📋 Description

• Assess AI-generated medical content for clinical precision, thoroughness, pertinence, and alignment with established medical standards.

• Evaluate whether AI-generated evaluations, differential diagnoses, and treatment suggestions are substantiated by valid clinical evidence.

• Detect incorrect medical information, unfounded conclusions, overlooked clinical factors, and possible patient safety issues.

• Confirm medical data using credible medical literature, recognized clinical guidelines, and evidence-based healthcare methodologies.

• Offer expert insights, clarify findings, identify areas for enhancement, and suggest clinically suitable corrections.

• Utilize evaluation protocols, scoring guidelines, and project-specific quality benchmarks to aid in the enhancement of AI quality.

• Conduct independent assessments using designated online platforms with accuracy and within defined project deadlines.

⛳️ Requirements

• At least three years of relevant professional clinical experience in a suitable specialty.

• A recognized medical degree, advanced-practice qualification, or equivalent professional certification relevant to the specialty and country.

• Proven experience in applying clinical judgment, diagnostic reasoning, or evidence-based medical practices.

• Strong grasp of medical terminology, clinical guidelines, and healthcare standards pertinent to the candidate's area of expertise.

• Capability to critically assess intricate medical information and differentiate between accurate clinical reasoning and unsupported assertions.

• Robust analytical, research, and problem-solving skills.

• Exceptional written English communication skills, including the capacity to clearly articulate clinical findings and professional evaluations.

• Familiarity with digital platforms, web-based applications, and online research tools.

• Ability to work autonomously, adhere to detailed instructions, and meet specified quality standards.

• Must be comfortable with and recognize that this is a task-oriented role.

• Preferred: current or prior professional licensure or registration relevant to the candidate's specialization.

• Preferred: experience in reviewing medical records, clinical research, medical guidelines, or healthcare quality evaluations.

• Preferred: knowledge of U.S. healthcare standards or clinical practices in the United Kingdom, Canada, Australia, or New Zealand.

• Preferred: experience in evaluating clinical documentation, medical literature, or complex healthcare cases.

• Preferred: prior involvement in AI model assessment, medical content review, clinical research, or healthcare technology.

• Experience with AI model evaluation, large language models (LLMs), research, or structured quality assessments is advantageous but not mandatory.

🏝️ Benefits

• Remote work from an eligible location.

• Project-based assignments with flexible schedules and workloads.

• Opportunity for supplemental income.

• Chance to contribute to advanced AI model evaluation without direct patient interaction.

• Experience in advancing AI technology and healthcare AI.

• No prior AI background necessary.