History & Political Science AI Benchmark Specialist

This is a fully remote position, open to applicants in New York.

📋 Description

• Create original and thought-provoking multiple-choice questions focused on history and political science.

• Ensure the factual accuracy, clarity, rigor, completeness, ambiguity, and solvability of pre-existing questions.

• Revise questions and answer choices while documenting substantial modifications with justifications.

• Formulate problems that necessitate the interpretation of historical evidence, context, causation, change over time, historiographical methods, and source criticism.

• Generate content related to political institutions, governance, public policy, political decision-making, comparative political analysis, national security, international relations, conflict, and policy trade-offs.

• Develop or assess specialized content in Business History, Environmental History, and Latin American History.

• Provide 1–5 academic references for each question when necessary.

• Compose structured explanations that support the correct answers.

• Evaluate question difficulty based on Medium, Hard, and Expert classifications.

• Assist in creating top-tier evaluation materials for measuring advanced AI capabilities.

⛳️ Requirements

• A PhD or current enrollment in a doctoral program in History, Political Science, International Relations, Public Policy, or a closely related field.

• A Master's degree may be accepted for candidates with outstanding expertise in a relevant subdomain.

• A strong understanding of historiographical methods, political analysis, and comparative reasoning.

• Proficiency in one or more areas including National Security, Public Policy, Business History, Environmental History, or Latin American History.

• Exceptional ability to assess evidence, differing interpretations, and complex causal arguments.

• Excellent command of written English with the ability to articulate sophisticated ideas clearly and accurately.

• Academic research publications are highly regarded.

• Relevant professional experience in policy, government, think tanks, or national security is a plus.

• University-level teaching or experience in academic assessment is highly valued.

• A keen attention to factual accuracy, ambiguity, source quality, and analytical rigor.

• Availability of at least 10 hours per week is expected.

• Work must be conducted without utilizing confidential or proprietary information from any employer, client, institution, or other third party.

• H1-B and STEM OPT support is not available for this position.

🏝️ Benefits

• Flexible scheduling tailored to project requirements.

• Completely remote and asynchronous work environment.

• Part-time engagement as an independent contractor.

• Project durations may be extended, shortened, or concluded based on project necessities and performance.

• H1-B and STEM OPT support is not available for this position.