Healthcare Subject Matter Expert – AI Model Evaluation

This is a fully remote position, open to applicants in United States, +6 more countries.

📋 Description

• Assess AI-generated medical content for clinical accuracy, completeness, relevance, and alignment with established medical standards.

• Evaluate AI-generated clinical reasoning, assessments, differential diagnoses, and treatment suggestions.

• Detect inaccuracies in medical information, unsupported conclusions, overlooked clinical considerations, and patient safety issues.

• Verify medical information against authoritative literature, clinical guidelines, and evidence-based healthcare practices.

• Offer expert feedback and clinically appropriate corrections.

• Implement evaluation guidelines, scoring criteria, and project-specific quality standards.

• Conduct independent evaluations using designated online platforms within specified project timelines.

• Assist in enhancing the accuracy, reliability, and healthcare reasoning of AI systems.

⛳️ Requirements

• A minimum of three years of relevant professional clinical experience in an applicable specialty.

• An accredited medical degree, advanced-practice qualification, or equivalent professional credential relevant to the specialty and country.

• Proven experience in applying clinical judgment, diagnostic reasoning, or evidence-based medical practices.

• Strong grasp of medical terminology, clinical guidelines, and healthcare standards pertinent to the candidate's area of expertise.

• Ability to critically assess complex medical information and differentiate accurate clinical reasoning from unsupported conclusions.

• Excellent analytical, research, and problem-solving skills.

• Exceptional written English communication abilities.

• Proficiency in using digital platforms, web-based applications, and online research tools.

• Capacity to work independently, adhere to detailed instructions, and meet established quality standards.

• Must be comfortable in a task-oriented role.

• Candidates sought include physicians, nurse practitioners, and physician assistants.

• Current or previous professional licensure or registration relevant to the specialty is preferred.

• Familiarity with U.S. healthcare standards or clinical practices in the United Kingdom, Canada, Australia, or New Zealand is advantageous.

• Experience in AI model evaluation, large language models, research, or structured quality assessment is beneficial but not a requirement.

🏝️ Benefits

• Opportunity for remote work from an eligible location.

• Project-based freelance opportunities.

• Flexible and variable scheduling, including potential weekday and weekend assignments.

• Chance to contribute to advanced AI model evaluation.

• No prior AI background is necessary.

• Supplemental income opportunity.