Business Domain Expert – AI Model Evaluation, Admin, Marketing, HR, Accounting

This is a fully remote position, open to applicants in United States.

📋 Description

• Execute a realistic, domain-specific professional task using the provided source files.

• Evaluate five AI-generated attempts at the same task.

• Rank these attempts from 1 to 5 without any ties.

• Assign a score to each attempt ranging from 0 to 100.

• Compose evidence-based rationales that reference specific elements of each output.

• Offer structured feedback regarding the task and study design.

• Sign a Non-Disclosure Agreement (NDA) prior to receiving study materials.

• Participate in a one-time evaluation pilot aimed at assessing the performance of advanced AI models and professional judgment.

⛳️ Requirements

• A minimum of 5 years of hands-on professional experience in Admin / Business Operations, Marketing, Human Resources, or Accounting.

• Currently or recently active in the relevant field.

• Capability to write clear, specific, and evidence-based rationales.

• Dependability within a short turnaround timeframe.

• Must sign an NDA before receiving any materials.

• Must not have participated in Project Alchemy in any role or accessed its source world data.

• Use of Large Language Models (LLMs) or other AI assistants is strictly prohibited at all stages.

• Must work as an independent contractor.

• Must have the legal right to work without H1-B or STEM OPT support.

🏝️ Benefits

• Fully remote position with a flexible schedule.

• Weekly payments processed through Stripe or Wise.

• Competitive compensation.

• Opportunity to collaborate with leading researchers.

• Chance to contribute to the development of the next generation of AI systems.

• Up to $320 for each successful referral, with no limit on the number of referrals (restrictions may apply).

• Reasonable accommodations available upon request.