
Real Estate Lawyer – AI Evaluation
Posted 8 hours ago

Posted 8 hours ago
This is a fully remote position, open to applicants in Canada.
• Recruit attorneys specializing in real estate for five simulated transactions.
• Modify draft documents to align with the jurisdiction where you practice.
• Verify documents, terminology, deadlines, and instructions pertinent to local practices.
• Generate reference answers for peer evaluation.
• Identify clauses, dates, calculations, or missing information that support conclusions.
• Develop scoring criteria that differentiate significant errors from acceptable variances.
• Implement scoring criteria on sample AI responses and adjust criteria as necessary.
• Conduct independent reviews of colleagues’ tasks, reference answers, and verification approaches.
• Evaluate sample AI responses, compare findings, and articulate any discrepancies.
• Suggest minimal adjustments that clarify assignments or scoring methods.
• Complete tasks autonomously in a designated virtual workspace.
• Must be licensed to practice in a Canadian province or territory.
• Experience in managing real estate transactions, such as reviewing titles, preparing adjustments, or coordinating closings.
• Capability to adapt draft documents to the jurisdiction of practice.
• Knowledge of local closing practices, documents, terminology, deadlines, and instructions.
• Ability to produce a reference answer that identifies clauses, dates, calculations, or missing information.
• Skills to write and apply scoring criteria for AI-generated answers.
• Competence to independently review a colleague’s task, reference answer, and verification process.
• All assignments must be completed without the use of generative AI.
• Maintain client and firm files outside of the provided workspace.
• Remote hourly contract available.
• Approximately 10 hours of work per lawyer.
• Virtual workspace will be provided.
• Access to public resources and supplied materials for research.
• Early-career lawyers with relevant experience are encouraged to apply.
• No prior experience with AI work is necessary.
Fortrea
BrightSpring Health Services
Alpaca Health
Alpaca Health
Get handpicked remote jobs straight to your inbox weekly.