Attorney, Evaluation Operations – Contract

This is a fully remote position, open to applicants in United States.

📋 Description

• Analyze various AI-generated outputs for the same legal tasks and assess their quality against a defined rubric.

• Evaluate new product features from start to finish in pre-release settings and offer qualitative insights based on legal expertise.

• Review and verify grading rubrics for precision and completeness.

• Create evaluation datasets that include realistic legal inquiries, contract modifications, and/or synthetic legal documents.

• Complete projects that generally require between 2 to 20 hours over several days.

• Provide feedback within a timeframe of 24 to 48 hours when necessary.

• Operate independently on projects that may be either accepted or declined.

⛳️ Requirements

• Juris Doctor (JD) degree.

• Active license to practice in at least one U.S. jurisdiction.

• Over 3 years of legal practice experience at an AmLaw 100 firm or a comparable legal department.

• Background in either commercial litigation or transactional law.

• Proficiency in using AI tools in a professional or everyday setting.

• Strong legal writing skills with the ability to articulate reasoning clearly in layman's terms.

• Availability for short-notice assignments and occasional weekend work.

• Must be based in the U.S.

• Preferred: Experience utilizing Harvey or another legal AI tool in practice.

• Preferred: Previous experience in grading, annotating, and/or reviewing AI-generated outputs.

• For litigators, familiarity with Lexis or Westlaw and experience in cite-checking are advantageous.

• A blend of law-firm and in-house experience is a plus.

🏝️ Benefits

• Harvey provides you with a laptop.

• Harvey sets up a Harvey account for access to pre-release environments.

• Eligibility for equity plans.

• Comprehensive health, dental, and vision insurance coverage.

• Retirement benefits with a 401(k) match up to 4%.

• Flexible paid time off (PTO).