Business Domain Expert – AI Model Evaluation Pilot, Admin, Marketing, HR, Accounting

This is a fully remote position, open to applicants in United States.

📋 Description

• Execute one authentic, domain-specific task utilizing the provided source files

• Evaluate five model-generated attempts for the designated task

• Assign a ranking to the attempts from 1 to 5 without any ties

• Rate each attempt on a scale from 0 to 100

• Draft evidence-based rationales that reference specific elements of each output

• Offer structured feedback regarding the task and study design

• Sign a Non-Disclosure Agreement (NDA) prior to receiving study materials

• Engage in a one-time, brief structured AI model evaluation pilot estimated to take 8 to 12 hours

⛳️ Requirements

• Over 5 years of practical professional experience in Human Resources or Accounting

• Currently or recently active in the relevant field

• Capability to compose clear, specific, and evidence-based rationales

• Dependability with a quick turnaround time

• Required to sign an NDA before accessing materials

• Must not have engaged with Project Alchemy in any form or accessed its source world data

• The use of LLMs or other AI assistants is forbidden at all stages

• Must be able to work as an independent contractor

• H1-B and STEM OPT candidates are not eligible

🏝️ Benefits

• Fully remote position with flexible self-scheduling options

• Weekly payments processed via Stripe or Wise

• Competitive compensation

• Chance to collaborate with leading researchers

• Opportunity to contribute to the development of the next generation of AI systems

• Referral program offering up to $400 for each successful referral, with no cap on the number of referrals (restrictions may apply)

• Reasonable accommodations available upon request