Scientific Chemistry, Python, AI Evaluation

This is a fully remote position, open to applicants in Bangladesh.

📋 Description

• Create scientific coding assignments that include a primary chemistry challenge along with at least three logically related and progressively structured sub-challenges.

• Develop validated golden solutions in Python, ensuring comprehensive unit test coverage.

• Design effective test cases that can differentiate between accurate and inaccurate AI-generated results.

• Conduct quality control validations using the Central Task Platform (CTP), which involves Tier 1 structural assessments and Tier 2 quality evaluations.

• Refine task specifications, implementations, and test cases in response to feedback from quality control.

• Enhance tasks to fulfill Pass@K evaluation standards across various LLM judges, such as GPT, Gemini, and Nemotron.

• Guarantee scientific accuracy, determinism, well-posedness, and compliance with project quality benchmarks.

• Aim for high-quality first submissions and reduce rework, striving for consistent Level 1 approval.

• Engage in review meetings, feedback discussions, and project standups during required overlapping hours.

⛳️ Requirements

• A Master's degree or PhD in Chemistry.

• Proficient Python programming capabilities with a background in scientific computing.

• Experience utilizing scientific Python libraries such as NumPy, SciPy, SymPy, or other relevant domain-specific tools.

• Skill in formulating rigorous scientific questions with precise constraints and anticipated outcomes.

• Experience in writing or implementing scientific solutions that include unit tests and deterministic results.

• Prior experience in AI data annotation, scientific research, or scientific writing.

• Familiarity with LLM evaluation frameworks, coding benchmarks, or assessments of AI-generated code.

• Published research or academic project experience related to chemistry or another STEM field.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Opportunities for professional development and continuous learning.

• Collaborative and innovative work environment.

• Flexible working hours and potential remote work options.