Materials Science Analyst

This is a fully remote position, open to applicants in Pakistan, +5 more countries.

📋 Description

• Develop scientific coding tasks that include one primary problem along with a minimum of three logically related sub-problems.

• Implement validated Python solutions that have comprehensive unit test coverage.

• Generate test cases that effectively differentiate between correct and incorrect outputs produced by AI.

• Conduct quality control assessments utilizing the Central Task Platform (CTP), which encompasses Tier 1 structural evaluations and Tier 2 quality rubrics.

• Modify tasks and solutions in response to quality control feedback.

• Enhance tasks in accordance with Pass@K evaluation standards across various LLM judges, including GPT, Gemini, and Nemotron.

• Ensure the scientific correctness, determinism, well-posedness, and expected outputs are validated.

• Keep a low rework rate while achieving high quality on first submissions.

• Engage in project reviews, feedback discussions, and standups during necessary overlap hours.

⛳️ Requirements

• Expertise in materials science.

• Proficiency in Python for scientific computing.

• Capability to design scientific coding tasks featuring one primary problem and at least three logically connected sub-problems.

• Ability to implement verified Python solutions that are fully covered by unit tests.

• Skill in creating test cases that clearly distinguish correct outputs from incorrect AI-generated results.

• Experience in conducting quality control checks with the Central Task Platform (CTP), which includes Tier 1 structural assessments and Tier 2 quality rubrics.

• Competence in optimizing tasks according to Pass@K evaluation criteria across judges such as GPT, Gemini, and Nemotron.

• Proficiency in validating scientific correctness, determinism, well-posedness, and expected outputs.

• Capability to maintain a low rework rate and high quality on first submissions.

• Ability to participate in project reviews, feedback sessions, and standups during required overlap hours.

🏝️ Benefits

• Opportunity to work in a cutting-edge scientific field.

• Collaborate with a team of experts and innovators.

• Access to professional development and growth opportunities.

• Flexible working hours to promote work-life balance.