Remotery

Human Data Evals Lead

Posted 1 hour ago

This is a fully remote position, open to applicants in Argentina.

πŸ“‹ Description

β€’ You will take charge of Anyone AI’s data projects and proposals to AI labs, managing everything from the initial data proposal or responding to requests, to the delivery of pilot projects.

β€’ You will be responsible for the creation of proposals and the development of sample packages and benchmarks.

β€’ Design and create the sample packages in collaboration with subject-matter experts.

β€’ Serve as a primary point of contact for lab partners via Slack and calls, with assistance from the CEO and the broader team.

β€’ Manage pilots from start to finish: including scoping, SOW, staffing, production, quality control, and delivery.


⛳️ Requirements

β€’ Over 5 years of experience in technical delivery, quality assurance, or program management, with recent involvement in AI/ML data, model evaluation, or benchmarking.

β€’ Practical experience in delivering data or evaluation services to AI labs or enterprise ML teams, from scoping to delivery.

β€’ Proficient understanding of how frontier models are assessed: including benchmarks, rubrics, pass rates, headroom, and the characteristics that differentiate a model's performance on a task.

β€’ Demonstrated leadership skills with people and vendors, having recruited, calibrated, and maintained a team or expert pool to uphold quality standards.

β€’ Proficient in English; Spanish is an additional asset.


🏝️ Benefits

β€’ Flexible work arrangements

β€’ Professional development

People also viewed

eSimplicity1 hour ago

Principal Data Lead

US flagUnited States OnlyFull-timeData Scientist$188.7k – $200k/year
ApplyView job
WorkWave1 hour ago

Applied Data Scientist / Machine Learning Engineer – Decision Intelligence

US flagUnited States OnlyFull-timeData Scientist$160k – $170k/year
ApplyView job
Kemper1 hour ago

Director, Data Science Operations

US flagIllinois OnlyFull-timeData Scientist$160.6k – $226.5k/year
ApplyView job
Forbes Advisor1 hour ago

Director of Data Science

US flagUnited States OnlyFull-timeData Scientist
ApplyView job
Forbes Advisor1 hour ago

Assistant Manager – Data Research

IN flagIndia OnlyFull-timeData Scientist
ApplyView job
FormativGroup2 hours ago

Data Strategy and Governance Manager

US flagAlabama, +27 more statesFull-timeData Scientist$160k – $180k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers