This is a fully remote position, open to applicants in Pakistan.

📋 Description

• Design scientific coding challenges that feature one primary chemistry issue along with a minimum of three logically related, progressively structured sub-problems.

• Develop validated golden solutions in Python, ensuring comprehensive unit test coverage.

• Create distinctive test cases that effectively differentiate between correct and incorrect outputs generated by AI.

• Conduct quality control validation via the Central Task Platform (CTP), incorporating Tier 1 structural assessments and Tier 2 quality rubrics.

• Revise task specifications, implementations, and test cases in response to quality control feedback.

• Optimize tasks to achieve Pass@K evaluation standards across various LLM judges, including GPT, Gemini, and Nemotron.

• Ensure scientific accuracy, determinism, well-posedness, and compliance with project quality benchmarks.

• Maintain high standards for first submissions and reduce rework, aiming for consistent L1 approval.

• Engage in review meetings, feedback sessions, and project standup meetings during necessary overlapping hours.

⛳️ Requirements

• A Master's degree or PhD in Chemistry.

• Proficient in Python programming with a solid background in scientific computing.

• Familiarity with scientific Python libraries such as NumPy, SciPy, SymPy, or other relevant domain-specific tools.

• Capability to formulate stringent scientific problems with explicit constraints and expected outcomes.

• Experience in writing or implementing scientific solutions that include unit tests and deterministic results.

• Prior involvement in AI data annotation, scientific research, or scientific writing.

• Understanding of LLM evaluation frameworks, coding benchmarks, or assessments of AI-generated code.

• Published research or experience in academic projects related to chemistry or another STEM field.

🏝️ Benefits

• Opportunity to work on cutting-edge scientific projects.

• Collaborative and innovative work environment.

• Professional development and growth opportunities.

• Competitive salary and benefits package.