Scientific Chemistry, Python, AI Evaluation

This is a fully remote position, open to applicants in Pakistan.

📋 Description

• Create scientific coding challenges that feature a primary chemistry issue along with at least three logically interconnected, progressively structured sub-issues.

• Develop validated golden solutions in Python, ensuring full unit test coverage.

• Design effective test cases that differentiate between correct and incorrect outputs generated by AI.

• Conduct quality control validation via the Central Task Platform (CTP), which includes Tier 1 structural assessments and Tier 2 quality rubrics.

• Refine task specifications, implementations, and test cases in response to quality control feedback.

• Enhance tasks to comply with Pass@K evaluation standards across various LLM judges, such as GPT, Gemini, and Nemotron.

• Guarantee scientific accuracy, determinism, well-defined problems, and compliance with project quality benchmarks.

• Uphold a high quality for first submissions and reduce the need for rework, aiming for consistent L1 approval.

• Engage in review meetings, feedback discussions, and project standups during designated overlap hours.

⛳️ Requirements

• A Master's degree or PhD in Chemistry.

• Proficient Python programming capabilities with a background in scientific computing.

• Experience with scientific Python libraries such as NumPy, SciPy, SymPy, or other relevant domain-specific tools.

• Ability to articulate rigorous scientific problems with defined constraints and anticipated outputs.

• Experience in writing or implementing scientific solutions that include unit tests and deterministic results.

• Previous experience in AI data annotation, scientific research, or scientific writing.

• Familiarity with LLM evaluation frameworks, coding benchmarks, or assessments of AI-generated code.

• Published research or practical project experience related to chemistry or another STEM field.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Opportunities for professional development and career advancement.

• Flexible working hours and remote work options.

• Collaborative and innovative work environment.

• Access to cutting-edge technology and resources.