Professional Services Practice Reviewer

This is a fully remote position, open to applicants in United States, +5 more countries.

📋 Description

• Evaluate the output produced by AI agents within the practitioner’s own area of professional services.

• Analyze the written task, the work generated by the AI agent, the produced files, and the scoresheet from the AI grader.

• Determine whether tasks are genuine, relevant to the job, realistic, borderline, or fabricated.

• Confirm domain-specific content, including standards, figures, regulations, and constraints.

• Examine eleven grader yes/no decisions and clarify any discrepancies.

• Independently score the work and evaluate if the score is justifiable.

• Ascertain whether a practitioner can utilize or accept the output.

• Allocate approximately one hour for each item reviewed.

• Focus solely on reviewing work; do not undertake the foundational task or redo the agent’s output.

• Participate in projects aimed at training and enhancing AI systems for Mercor’s AI lab and its enterprise partners.

⛳️ Requirements

• Active professional practitioner in one of the following fields: Project Management Specialist, Lawyer, Accountant or Auditor, Software Developer, or Computer and Information Systems Manager.

• Project Management Specialists: Over 5 years of experience managing actual project plans, schedules, and budgets that others have followed.

• Lawyers: Must be US-qualified and actively practicing, with a minimum of 4 years post-admission experience, drafting their own documents instead of solely reviewing.

• Accountants and Auditors: At least 4 years of experience managing a close, an audit file, or a set of financial statements.

• Software Developers: Minimum of 3 years of experience delivering production code that has been maintained by other engineers afterward.

• Computer and Information Systems Managers: Over 4 years of experience overseeing an IT function, including its budget and vendors.

• Near-native proficiency in business English.

• Familiarity with spreadsheets or PDFs to ensure numerical accuracy.

• Field expertise evidenced by reviewing junior team members' work, signing audit opinions, conducting significant code reviews, or engaging in project post-mortems.

• Proven history of delivery; candidates who only possess certification without delivery experience are not a suitable fit.

• Engagement as an independent contractor.

• Applicants must have the ability to work without H1-B or STEM OPT sponsorship.

🏝️ Benefits

• Fully remote work environment.

• Flexible scheduling; tasks can be completed at your convenience.

• Weekly payments through Stripe or Wise based on services provided.

• Project durations may be extended, shortened, or concluded early based on requirements and performance.

• Competitive compensation.

• Collaboration with top researchers.

• Opportunity to influence the development of the next generation of AI systems.

• Up to $350 referral bonus for each successful referral, with no limit on the number of referrals (restrictions may apply).

• Reasonable accommodations available upon request.