This is a fully remote position, open to applicants in United States.

📋 Description

• Assess AI-generated writing aimed at developers by comparing it to client task briefs and writing guidelines.

• Review CLI help documentation, error notifications, and API reference materials.

• Analyze diffs and terminal outputs to pinpoint inaccurate technical descriptions.

• Choose the optimal sample, indicate a tie, or classify samples as unsuitable for evaluation.

• Provide a concise rationale for each decision made.

• Utilize tags to support the evaluation decisions.

• Successfully complete a calibration gate before progressing to live data.

• Transition from a five-day pilot phase to an ongoing month-to-month engagement.

⛳️ Requirements

• Experience in leading developer documentation at a prominent technology firm, especially in cloud platforms, API-first products, or developer tools.

• Proficient in writing or assessing CLI help, error messages, and API reference documentation.

• Previous experience in evaluating AI-generated writing is highly advantageous.

• Must successfully pass a calibration gate using a known-answer test set prior to working with live data.

• Availability for 5 hours each day, across 5 business days for the pilot phase.

• Must operate as an independent contractor.

• H1-B and STEM OPT candidates are not eligible.

🏝️ Benefits

• Work fully remote.

• Enjoy a flexible schedule and the ability to work at your own pace.

• Receive weekly payments through Stripe or Wise.

• Project durations may be extended, shortened, or concluded early based on requirements and performance.

• Competitive remuneration.

• Collaborate with top researchers in the field.

• Contribute to shaping the future of AI systems.

• Earn referral bonuses of up to $340 for each successful referral.