Evaluations Operations Analyst – Contract

This is a fully remote position, open to applicants in California.

📋 Description

• Oversee evaluation tasks assigned to our annotator workforce and manage the distribution of assignments across various projects and locations.

• Monitor and confirm the completion of assignments, addressing delays or issues proactively to prevent them from becoming obstacles.

• Serve as the primary point of contact for evaluators, addressing operational inquiries regarding project setup, platform access, and task instructions.

• Assist in maintaining project trackers, assignment logs, and operational documentation.

• Support calibration workflows as necessary to ensure that evaluation data meets our quality standards.

⛳️ Requirements

• Proven experience in managing or coordinating annotator workforces, including task assignment, scheduling, and follow-up activities.

• Practical experience with data annotation platforms.

• Excellent written communication skills, especially in coordinating with contractor workforces distributed globally across different time zones and languages.

• Capability to work independently and manage your time effectively to meet stringent project deadlines.

• Proficiency in using spreadsheets, task management tools (e.g., Asana), and messaging platforms (e.g., Slack).

🏝️ Benefits

• Competitive base salary along with an appealing equity package.

• Comprehensive medical insurance, including dental and vision coverage for you and your family.

• 9 weeks of paternity leave and 12 weeks of maternity leave.

• 401(k) retirement plan.

• A monthly stipend to assist with commuting to and from the office.

• Ample time off to recharge as needed.

• Daily provision of lunch, dinner, and a variety of snacks.

• Your own personal Yoshi.