
Study Domain Expert – Judge Calibration – Sales
Posted Sep 12

Posted Sep 12
This is a fully remote position, open to applicants in United States.
• Utilize professional judgment to execute practical Sales tasks
• Accomplish one realistic Sales assignment using provided source materials
• Evaluate outputs generated by the model, assign rankings and scores, and compose evidence-based rationales
• Offer structured feedback regarding the task and overall study design
• Engage in a 13-hour study scheduled from September 12–15, 2026
• Contribute to projects focused on training and improving AI systems
• Over 5 years of experience in Sales or a closely related field
• Preferably held a managerial, director, or principal-level Sales position; entry-level experience alone is not sufficient
• Fluent or native English speaker
• Previous experience as an expert is advantageous
• Must sign a Non-Disclosure Agreement before receiving study materials
• No use of large language models or other AI assistants during the study
• Individuals who have participated in Project Alchemy in any role or accessed its source-world data are ineligible
• Must be engaged as an independent contractor
• H1-B and STEM OPT candidates are not eligible for this position
• Weekly compensation via Stripe or Wise based on services performed
• Fully remote work environment
• Flexible working hours; tasks can be completed at your convenience
• Competitive remuneration
• Opportunity to collaborate with prominent researchers
• Chance to influence the development of next-generation AI systems
• Referral rewards of up to $360 for each successful referral
• Reasonable accommodations available upon request
Personalbüro U. Herrmann
Indivior
Astrana Health
Get handpicked remote jobs straight to your inbox weekly.