Accounting Expert – AI Model Evaluation

This is a fully remote position, open to applicants in United Kingdom, +3 more countries.

📋 Description

• Create realistic accounting tasks that encompass month-end closing, bank and credit card reconciliations, AR/AP aging, accruals and adjusting entries, sales tax, job costing, and addressing incomplete or inconsistent financial records.

• Evaluate deal-room documents, identify relevant files, and formulate prompts and evaluation rubrics.

• Produce usable deliverables such as spreadsheets, journal entry schedules, or concise memos.

• Execute requests using frontier AI models and assess outputs, ensuring quality control for accounting work that is being finalized.

• Gradually increase the complexity of tasks until a genuine model gap becomes evident.

• Develop objective scoring rubrics that reviewers can consistently apply.

• Adhere to task and rubric guidelines, identify ambiguous situations, and assist in refining evaluation criteria.

⛳️ Requirements

• A minimum of 5 years of experience in accounting, bookkeeping, or finance operations.

• Previous experience in AI training or data annotation is essential.

• Practical knowledge of month-end closing, reconciliations, AR/AP, accruals and adjusting entries, sales tax, and job costing.

• Exceptional written English skills and a strong aptitude for numerical accuracy.

• Detail-oriented and meticulous: ensuring accurate figures and establishing objective, verifiable criteria.

• Availability for 20 to 40 hours per week during an initial one-week trial period, with the possibility of extension.

• An NDA must be signed prior to the commencement of the engagement.

🏝️ Benefits

• Competitive salary.

• Comprehensive training provided.

• Opportunity for extension following the initial one-week trial.