Applied Physicist – AI Benchmarking

This is a fully remote position, open to applicants in New York.

📋 Description

• Create original multiple-choice physics questions that evaluate a deep understanding of physical concepts.

• Design challenging problems across various advanced physics fields.

• Ensure that questions are self-sufficient, precise, clear, and can be solved independently.

• Develop questions tailored for undergraduate, advanced undergraduate, and postgraduate levels of difficulty.

• Generate one correct answer along with nine plausible distractors.

• Review existing physics questions for accuracy, clarity, rigor, and completeness.

• Detect conceptual flaws, hidden assumptions, mathematical errors, and issues related to solvability.

• Modify questions and answer options as necessary.

• Validate calculations, derivations, physical reasoning, and the designated correct answers.

• Document significant changes and articulate the scientific rationale behind them.

• Create assessment content in semiconductor physics, nanoelectronics, spintronics, quantum technologies, photonics, quantum optics, ultrafast physics, plasma physics, fusion energy, nonlinear dynamics, turbulence, geophysics, and reservoir simulation.

• Provide 1–5 academic references per question when necessary.

• Develop structured solution explanations to support the correct answers.

• Assess question difficulty using Medium, Hard, and Expert standards.

• Assist in maintaining consistent scientific and academic quality across benchmark content.

• Contribute to evaluation materials for advanced AI systems.

⛳️ Requirements

• PhD or current doctoral candidacy in Physics, Applied Physics, Astrophysics, or a closely related field.

• A Master's degree may be considered for candidates with exceptional expertise in a relevant physics subdomain.

• Strong command of graduate-level physics and mathematical formalism.

• Expertise in one or more of the following areas: semiconductor physics, nanoelectronics, spintronics, photonics, quantum optics, ultrafast physics, quantum sensing, plasma physics, fusion energy, nonlinear dynamics, turbulence, geophysics, or reservoir simulation.

• Proven ability to construct and verify rigorous quantitative and conceptual physics problems.

• Excellent written English skills with the ability to communicate complex physical concepts clearly and accurately.

• Academic research publications are highly regarded.

• Experience in experimental, theoretical, or computational physics research is advantageous.

• Experience with physics olympiad writing, examination development, or advanced problem design is highly valued.

• Strong attention to mathematical precision, physical consistency, and problem solvability.

• Availability of at least 10 hours per week.

• Must work without utilizing confidential or proprietary information belonging to any employer, client, institution, or other third party.

• H1-B and STEM OPT support is not available for this engagement.

🏝️ Benefits

• Flexible scheduling based on project needs.

• Fully remote and asynchronous work environment.

• Part-time independent contractor role.

• Expected availability of at least 10 hours weekly.

• Opportunity to contribute to gold-standard evaluation materials used to assess advanced AI capabilities.

• Project timelines may be adjusted based on needs and performance.