
Government Subject Matter Expert β AI Model Evaluation
Posted Oct 20

Posted Oct 20
This is a fully remote position, open to applicants in United States.
β’ Assess AI-generated responses for their accuracy, completeness, reasoning, and compliance with regulations in intricate government-related contexts.
β’ Utilize expert judgment to evaluate whether the conclusions drawn by AI are suitable, defensible, and backed by relevant policies or regulations.
β’ Detect incorrect interpretations, erroneous assumptions, absent information, and potential compliance issues.
β’ Confirm findings against laws, regulations, agency guidelines, and professional standards.
β’ Create evaluation benchmarks, reference responses, assessment criteria, and examples of sound professional reasoning.
β’ Offer actionable feedback and suggest enhancements to AI-generated content.
β’ Implement project-specific evaluation standards and engage in quality reviews to ensure consistency and accuracy.
β’ Minimum of 2 years of relevant professional experience in government operations, public administration, regulatory compliance, government procurement, or a closely aligned field.
β’ Proven subject matter expertise in at least one area of government specialization.
β’ Experience in interpreting, evaluating, auditing, or applying government policies, regulations, or professional standards.
β’ Strong analytical reasoning skills with the ability to identify errors, inconsistencies, and unsupported conclusions.
β’ Exceptional written communication abilities, including the capacity to articulate complex findings clearly and succinctly.
β’ Competence in conducting independent research and verifying information through authoritative sources.
β’ Familiarity with digital platforms, online research tools, and structured evaluation criteria.
β’ Current U.S. residency and capability to work independently in a remote, project-based setting.
β’ Ability to successfully complete a skills-based assessment.
β’ Availability for weekday or weekend work may be required.
β’ Flexibility to work remotely on a project basis.
β’ Opportunities for future projects based on availability and performance.
Creatio
Kyndryl
Tenpo
Mindrift
Get handpicked remote jobs straight to your inbox weekly.