Surgical Video Annotation Program Lead

This is a fully remote position, open to applicants in United States.

📋 Description

• Take full ownership of the comprehensive delivery of a high-throughput, clinically defensible, audit-ready surgical video annotation program—focusing on automation-first workflows, quality (IRR/QA), and timely dataset releases.

• Establish and manage the annotation “factory” from intake → de-ID → task orchestration → annotation → QA/IRR → adjudication → dataset release + evidence pack.

• Collaborate with clinical subject matter experts (SMEs) to operationalize a procedure-specific ontology (phases/steps, tools, anatomy, events) and transform it into clear labeling guidelines and UI rules.

• Lead pre-labeling + verification workflows, implement routing based on model confidence/uncertainty, and consistently minimize human effort per labeled minute.

• Introduce and enforce a multi-rater sampling strategy IRR reporting by label type (kappa/alpha; IoU/Dice where applicable), calibration loops, and retraining for annotators through QA gates + sampling plans with acceptance thresholds.

• Manage the disagreement workflow, oversee escalation to senior annotators/clinical reviewers, and ensure guideline updates address recurring issues.

• Be responsible for versioning, provenance, and release discipline—guaranteeing that each dataset is reproducible and is accompanied by an audit-ready Evidence Pack.

⛳️ Requirements

• 6–10+ years of experience in annotation operations / data operations / QA-led delivery, with a minimum of 2+ years in a leadership role overseeing teams and SLAs.

• Practical experience in video annotation (temporal segmentation + event labeling) and familiarity with bounding boxes/segmentation concepts.

• Proven capability to implement multi-rater workflows, compute/interpret IRR, and conduct calibration to enhance consistency.

• Strong program management abilities: planning, staffing, throughput modeling, risk management, and stakeholder communication.

• Proficiency in working with tooling/APIs and structured data exports; adept at translating guidelines into enforceable rules within tools.

• Experience in regulated or sensitive-data environments (healthcare preferred): possess a privacy-first mindset, maintain audit trails, and adhere to process discipline.

🏝️ Benefits

• Remote work options