
RN Clinical Data Annotation Specialist
Posted 14 hours ago

Posted 14 hours ago
This is a fully remote position, open to applicants in United States.
• Evaluate recorded and simulated interactions of AI agents within primary care, chronic disease management, care management, medication adherence, and scheduling.
• Analyze agent responses for clinical precision, safety, and suitability.
• Rate and annotate agent performance utilizing structured evaluation frameworks that align with evidence-based protocols and clinical practice standards.
• Detect clinical safety issues, inappropriate suggestions, edge cases, and deficiencies in agent clinical reasoning.
• Deliver concise, actionable written feedback to both clinical and product teams.
• Engage in regular calibration sessions to maintain consistent annotation standards.
• Active, unrestricted RN license in the United States; compact license is preferred.
• A minimum of 5 years of direct clinical experience.
• Strong clinical judgment along with a solid understanding of evidence-based protocols and clinical practice guidelines.
• Proficient in reviewing written transcripts and applying structured rubrics with meticulous attention to detail.
• Excellent written communication skills for clearly documenting feedback and corrections.
• Capable of working independently and meeting turnaround expectations.
• Previous experience in clinical quality assurance, utilization review, or case review is recommended.
• Experience with chart audits or clinical documentation review is recommended.
• Familiarity with AI-assisted clinical tools or digital health platforms is recommended.
• Legally authorized to work in the United States.
• Registered Nurse or Nurse Practitioner license must be active and unrestricted in the United States.
• Flexible scheduling.
• Fully remote work arrangement.
• Opportunity to collaborate with a healthcare-focused, safety-oriented LLM platform.
• Involvement in periodic calibration sessions with fellow clinical reviewers.
• Consideration for flexible part-time availability (20–40 hours/week).
NAI Global
Reimagined Parking
RELX
LexisNexis
Get handpicked remote jobs straight to your inbox weekly.