Professional Services Evaluation Consultant

This is a fully remote position, open to applicants in United States, +6 more locations.

📋 Description

• Review comprehensive AI-generated work outputs that reflect realistic tasks from the consultant’s field of expertise.

• Analyze task instructions, completed deliverables, supporting documentation, and evaluation outcomes.

• Evaluate if the work represents authentic professional practice.

• Identify significant issues that are evident to an experienced professional.

• Assess the usability and acceptability of outputs in a genuine professional context.

• Evaluate task descriptions, constraints, expected deliverables, and their alignment with standard industry practices.

• Provide succinct explanations that justify your evaluations.

• Review technical, legal, financial, operational, or professional content for precision.

• Identify incorrect standards, figures, regulations, assumptions, terminology, or limitations.

• Detect nuanced domain-specific challenges.

• Ensure consistency among instructions, supporting data, and completed outputs.

• Utilize current professional judgment to assess quality and accuracy.

• Review existing yes/no grading decisions in relation to completed work.

• Identify unsupported or inconsistent grading decisions and articulate disagreements.

• Maintain consistent standards across evaluated work products.

• Independently assess overall work-product quality and assign an appropriate quality band.

• Compare assessments with reported evaluation scores and pinpoint inaccuracies.

• Provide brief, clear rationales for review decisions in precise business English.

• Differentiate between material issues and minor presentation errors.

• Support evaluations with relevant professional standards or practical experience.

• Complete approximately one hour of review work for each item.

⛳️ Requirements

• Significant hands-on experience in one of the following areas: project management, law, accounting and audit, software development, or IT and information systems management.

• Project Management: 5+ years of experience managing actual project plans, schedules, and budgets.

• Project Management: Proven experience overseeing deliverables that teams actively worked toward.

• Project Management: Strong knowledge of professional project-management documentation and controls.

• PMP certification is a plus but not mandatory.

• Law: US-qualified attorney in active practice.

• Law: 4+ years of post-admission experience.

• Law: Practical experience in drafting legal documents.

• Law: Capability to assess legal accuracy, terminology, and professional work products.

• Accounting & Audit: 4+ years of professional experience.

• Accounting & Audit: Hands-on involvement in financial close processes, audit files, or financial statements.

• Accounting & Audit: Strong understanding of accounting and audit documentation.

• CPA or CA qualification is highly preferred.

• Software Development: 3+ years of professional software development experience.

• Software Development: Experience delivering production code that is subsequently maintained by other engineers.

• Software Development: Ability to evaluate code quality, implementation choices, and practical development practices.

• Software Development: Previous experience conducting substantial code reviews is highly relevant.

• IT & Information Systems Management: 4+ years of professional experience managing an IT function.

• IT & Information Systems Management: Practical responsibility for budgets, vendors, systems, and operational choices.

• IT & Information Systems Management: Experience creating or reviewing professional IT work products.

• IT & Information Systems Management: Strong understanding of real-world technology operations and management.

• Proven history of successful delivery within the chosen profession.

• Experience reviewing the work of juniors or peers is especially valuable.

• Near-native proficiency in business English.

• Ability to provide concise written explanations for professional evaluations.

• Comfortable reviewing spreadsheets, PDFs, and other professional documents.

• Capable of verifying figures, calculations, and internal consistency.

• Significant hands-on delivery experience; certification-based experience alone is less suitable.

• Work must be conducted without using confidential or proprietary information belonging to any employer, client, institution, or other third party.

• H1-B and STEM OPT support is unavailable for this engagement.

🏝️ Benefits

• Part-time independent contractor engagement.

• Fully remote position.

• Flexible scheduling based on project requirements.

• Projects may be extended, shortened, or concluded based on project needs and performance.