Applied Legal Benchmark Specialist

This is a fully remote position, open to applicants in United States.

📋 Description

• Create original and thought-provoking multiple-choice legal questions within your area of legal expertise.

• Evaluate and categorize question difficulty levels as Medium, Hard, or Expert.

• Examine existing questions to ensure legal accuracy, clarity, completeness, precision, and rigor.

• Make necessary revisions and document the rationale behind your edits.

• Guarantee that questions are clear, unambiguous, self-contained, and provide enough detail for a definitive answer.

• Offer one correct answer along with nine plausible but subtly incorrect alternatives.

• Craft concise, logically structured explanations that showcase appropriate legal reasoning.

• Include 1–5 credible academic or professional references for each question.

• Maintain consistent quality standards and contribute to reliable legal evaluation benchmarks for AI research.

• Engage asynchronously on a flexible schedule for project-based assignments.

⛳️ Requirements

• JD, LLM, SJD, or a doctoral-level qualification in Law or a closely related field.

• Candidates with a Master's degree may be considered if they possess exceptional specialized legal expertise.

• Strong proficiency in legal reasoning, statutory and regulatory interpretation, case analysis, and legal research.

• In-depth knowledge in at least one area of legal practice covered.

• Excellent written English skills with the ability to convey complex legal concepts clearly, precisely, and concisely.

• Keen attention to detail and an aptitude for identifying subtle legal inaccuracies or ambiguities.

• Experience in legal education, development of bar examination content, academic assessment, judicial clerkships, legal research, or legal writing is highly regarded.

• Previous involvement in AI evaluation, training data, benchmarking, or human-in-the-loop research is advantageous.

• Commitment to working 10+ hours per week.

• Engagement as an independent contractor.

• H-1B and STEM OPT candidates are not eligible.

• Ability to submit a resume or relevant professional background that highlights legal specialization and experience.

• Selected candidates may need to complete a brief sample assessment or provide additional subject-matter information.

🏝️ Benefits

• Fully remote work opportunity.

• Asynchronous and flexible working style.

• Flexible scheduling options.

• Project-based opportunities with the potential for ongoing participation.

• Weekly payments based on services provided.

• Engagement as an independent contractor.

• Reasonable accommodations available upon request.