Government Subject Matter Expert, AI Model Evaluation

This is a fully remote position, open to applicants in United States.

📋 Description

• Assess the accuracy, completeness, reasoning, and regulatory compliance of AI-generated responses.

• Utilize expert judgment to evaluate the appropriateness, defensibility, and policy support of AI-generated conclusions.

• Detect incorrect interpretations, erroneous assumptions, missing information, and compliance issues.

• Cross-check findings against statutes, regulations, agency guidelines, and professional standards.

• Create evaluation benchmarks, reference responses, assessment criteria, and examples of sound professional reasoning.

• Offer constructive feedback and suggest enhancements to AI-generated content.

• Implement project-specific evaluation guidelines and engage in quality review processes.

• Contribute to enhancing the accuracy and reliability of AI-generated information for challenges in the public sector.

⛳️ Requirements

• Minimum of 2 years of relevant professional experience in government operations, public administration, regulatory compliance, government procurement, or a closely related discipline.

• Proven subject matter expertise in at least one area of government specialization.

• Experience in interpreting, evaluating, auditing, or applying government policies, regulations, or professional standards.

• Strong analytical skills with the ability to spot inaccuracies, inconsistencies, and unsupported conclusions.

• Exceptional written communication abilities, including the capacity to clearly and concisely articulate complex findings.

• Capability to conduct independent research and verify information using reliable sources.

• Proficiency in utilizing digital platforms, online research tools, and structured evaluation guidelines.

• Must be a current U.S. resident and capable of working independently in a remote, project-based setting.

• Successful completion of a skills-based assessment is required.

• Availability may be required on weekdays or weekends.

• Experience with AI model evaluation, large language models (LLMs), research, or structured quality assessments is advantageous but not mandatory.

🏝️ Benefits

• Flexibility with remote, project-based work.

• Opportunities for future projects based on performance and availability.