Scientific Chemistry, Python, AI Evaluation

This is a fully remote position, open to applicants in Bangladesh.

📋 Description

• Create scientific coding tasks that include one primary chemistry challenge along with a minimum of three logically interconnected, progressively structured sub-challenges.

• Develop validated golden solutions in Python, ensuring comprehensive unit test coverage.

• Generate distinct test cases that differentiate between correct and incorrect outputs produced by AI.

• Perform quality control validation via the Central Task Platform (CTP), which includes Tier 1 structural assessments and Tier 2 quality metrics.

• Revise task specifications, implementations, and test cases based on quality control feedback.

• Enhance tasks to align with Pass@K evaluation standards across various LLM judges, including GPT, Gemini, and Nemotron.

• Guarantee scientific accuracy, determinism, well-defined conditions, and compliance with project quality expectations.

• Aim for high-quality first submissions and reduce rework, with a goal of achieving consistent L1 approval.

• Engage in review meetings, feedback sessions, and project standups during designated overlap hours.

⛳️ Requirements

• Master’s degree or PhD in Chemistry.

• Proficient Python programming skills with a background in scientific computing.

• Experience utilizing scientific Python libraries such as NumPy, SciPy, SymPy, or other relevant domain-specific tools.

• Capability to formulate rigorous scientific problems with explicit constraints and anticipated outcomes.

• Experience in writing or implementing scientific solutions that include unit tests and produce deterministic outputs.

• Prior involvement in AI data annotation, scientific research, or scientific writing.

• Familiarity with LLM evaluation frameworks, coding benchmarks, or assessments of AI-generated code.

• Published research or experience in academic projects related to chemistry or another STEM field.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Flexible working hours and remote work opportunities.

• Professional development and training programs.

• Collaborative and innovative team environment.

• Access to cutting-edge technology and resources.