Physics, Python Specialist

This is a fully remote position, open to applicants in Pakistan.

📋 Description

• Create scientific coding assignments that include a primary physics challenge along with at least three logically related sub-challenges.

• Develop verified golden solutions in Python, ensuring comprehensive unit test coverage.

• Generate test cases that effectively differentiate between correct and incorrect outputs produced by AI.

• Conduct quality assurance assessments using the Turing Central Task Platform (CTP), which involves Tier 1 structural evaluations and Tier 2 quality rubrics.

• Modify scientific tasks and solutions based on feedback from quality control processes.

• Refine tasks to satisfy Pass@K evaluation standards across various LLM judges, including GPT, Gemini, and Nemotron.

• Ensure the scientific accuracy, well-posedness, determinism, and anticipated outputs of tasks.

• Uphold high-quality standards for initial submissions and reduce the need for revisions.

• Engage in reviews, feedback discussions, and project meetings during designated overlap hours.

⛳️ Requirements

• A Master’s degree or PhD in Physics.

• Proficient in Python programming with a background in scientific computing.

• Experience with scientific Python libraries, such as NumPy, SciPy, SymPy, or other relevant domain-specific tools.

• Capability to articulate rigorous physics problems with well-defined constraints and expected outcomes.

• Background in implementing scientific solutions that include unit tests and deterministic outputs.

• Previous experience in AI data annotation, scientific research, or scientific writing.

• Knowledge of LLM evaluation frameworks or coding benchmarks.

• Published research or experience in academic projects related to physics or other STEM fields.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Opportunities for professional development and continuous learning.

• Flexible working hours and remote work options.

• Collaborative and innovative work environment.