This is a fully remote position, open to applicants in Portugal.

📋 Description

• Evaluate advanced language models in subjects such as mathematics, physics, chemistry, engineering, data science, computer science, and scientific computing.

• Engage in discussions with models regarding real-world STEM problem-solving situations and theoretical technical inquiries.

• Assess the factual accuracy and logical validity of the responses generated by the models.

• Document reproducible error traces and outline failure modes.

• Propose enhancements for prompt engineering and evaluation criteria.

• Assist in generating high-quality training data for future AI systems.

⛳️ Requirements

• Expertise in STEM fields such as mathematics, physics, chemistry, engineering, data science, computer science, or scientific computing.

• Proficiency in Portuguese (Portugal).

• A bachelor’s or master’s degree in a STEM discipline is preferred.

• Experience in published research, engineering design, data analysis projects, or coding portfolios is indicative of a suitable candidate.

• Strong metacognitive communication skills and the ability to "show your work."

• Capability to discuss advanced STEM topics, including thermodynamics, mechanics, calculus, statistics, materials science, electronics, algorithm design, and quantitative modeling.

• Competence in verifying factual accuracy and logical soundness.

• Ability to document reproducible error traces.

• Skill in suggesting improvements for prompt engineering and evaluation metrics.