Study Domain Expert – Judge Calibration – Sales

This is a fully remote position, open to applicants anywhere in the world.

📋 Description

• Utilize professional judgment to assess realistic Sales tasks and evaluate outputs generated by models.

• Execute one realistic Sales assignment using provided source materials.

• Analyze model outputs, assign ranks and scores, and create evidence-based rationales.

• Offer structured feedback regarding the task and the overall study design.

• Engage in a 13-hour study scheduled from September 12–15, 2026.

⛳️ Requirements

• Over 5 years of experience in Sales or a closely related field.

• Ideally have held a manager, director, or principal-level Sales position; entry-level experience is not sufficient.

• Fluent or native English speaker.

• Previous experience as an expert is advantageous.

• Must sign a Non-Disclosure Agreement (NDA) prior to receiving study materials.

• No use of LLMs or other AI tools during the study.

• Individuals who have participated in Project Alchemy in any role or accessed its source-world data are ineligible.

• Unable to accommodate H1-B or STEM OPT candidates at this time.

• Must operate as an independent contractor.

🏝️ Benefits

• Payments are made weekly via Stripe or Wise based on services provided.

• Fully remote position that allows for a flexible schedule.

• Competitive compensation.

• Opportunity to collaborate with leading researchers.

• Contribute to the development of the next generation of AI systems.