
Human Data Evals Lead
Posted 1 hour ago

Posted 1 hour ago
This is a fully remote position, open to applicants in Argentina.
β’ You will take charge of Anyone AIβs data projects and proposals to AI labs, managing everything from the initial data proposal or responding to requests, to the delivery of pilot projects.
β’ You will be responsible for the creation of proposals and the development of sample packages and benchmarks.
β’ Design and create the sample packages in collaboration with subject-matter experts.
β’ Serve as a primary point of contact for lab partners via Slack and calls, with assistance from the CEO and the broader team.
β’ Manage pilots from start to finish: including scoping, SOW, staffing, production, quality control, and delivery.
β’ Over 5 years of experience in technical delivery, quality assurance, or program management, with recent involvement in AI/ML data, model evaluation, or benchmarking.
β’ Practical experience in delivering data or evaluation services to AI labs or enterprise ML teams, from scoping to delivery.
β’ Proficient understanding of how frontier models are assessed: including benchmarks, rubrics, pass rates, headroom, and the characteristics that differentiate a model's performance on a task.
β’ Demonstrated leadership skills with people and vendors, having recruited, calibrated, and maintained a team or expert pool to uphold quality standards.
β’ Proficient in English; Spanish is an additional asset.
β’ Flexible work arrangements
β’ Professional development
eSimplicity
WorkWave
Kemper
Forbes Advisor
Get handpicked remote jobs straight to your inbox weekly.