
Healthcare Subject Matter Expert – AI Model Evaluation
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in India, +6 more countries.
• Assess AI-generated medical content for accuracy, completeness, relevance, and alignment with established medical standards.
• Examine AI-generated clinical reasoning, evaluations, differential diagnoses, and treatment suggestions.
• Detect incorrect medical information, unsupported assertions, overlooked clinical considerations, and patient safety issues.
• Verify medical information against authoritative medical literature, clinical guidelines, and evidence-based healthcare practices.
• Offer structured expert feedback and clinically suitable corrections.
• Implement evaluation guidelines, scoring criteria, and project-specific quality benchmarks.
• Conduct independent evaluations utilizing the DataCompute platform within specified project timelines.
• Contribute clinical expertise towards enhancing the precision and reliability of healthcare AI models.
• At least three years of pertinent professional clinical experience in a relevant specialty.
• A recognized medical degree, advanced-practice qualification, or equivalent professional credential relevant to the specialty and country.
• Proven experience in applying clinical judgment, diagnostic reasoning, or evidence-based medical practices.
• Strong comprehension of medical terminology, clinical guidelines, and healthcare standards pertinent to the specialization.
• Ability to critically analyze complex medical information and differentiate accurate clinical reasoning from unsupported claims.
• Strong analytical, research, and problem-solving skills.
• Excellent written communication skills in English.
• Proficient in utilizing digital platforms, web-based applications, and online research tools.
• Capable of working independently, adhering to detailed instructions, and meeting established quality standards.
• Must be comfortable with a task-oriented role.
• Open to physicians, nurse practitioners, and physician assistants.
• Current or prior professional licensure or registration relevant to the specialty is preferred.
• Familiarity with U.S. healthcare standards or clinical practices in the United Kingdom, Canada, Australia, or New Zealand is preferred.
• Experience in AI model evaluation, large language model research, or structured quality assessment is advantageous but not mandatory.
• Work remotely.
• Engage in project-based freelance work.
• Enjoy a flexible and variable schedule, including potential assignments on weekdays and weekends.
• Opportunity to participate in advanced AI model evaluation.
• No prior AI background necessary.
• Supplement your income.
Volga Partners
Gramian Consulting
Gramian Consulting
GE Aerospace
Get handpicked remote jobs straight to your inbox weekly.