AI Content Specialist, Mathematics, Python

This is a fully remote position, open to applicants in Pakistan.

📋 Description

• Create mathematical coding tasks that consist of one primary problem along with at least three logically interconnected sub-problems that progressively lead to the main solution.

• Implement validated golden solutions in Python, ensuring comprehensive unit test coverage.

• Develop distinctive test cases that differentiate between correct and incorrect AI-generated outputs.

• Conduct quality control validation utilizing the Central Task Platform (CTP), which includes Tier 1 structure assessments and Tier 2 quality rubrics.

• Enhance problem specifications, solutions, and test cases based on quality control feedback.

• Optimize tasks to satisfy Pass@K evaluation criteria across various LLM judges, including GPT, Gemini, and Nemotron.

• Ensure mathematical accuracy, well-posedness, determinism, and adherence to project quality benchmarks.

• Maintain superior first-submission quality and reduce rework, aiming for consistent L1 approval.

• Engage in review sessions, feedback meetings, and project standups during necessary overlap hours.

⛳️ Requirements

• A Master's degree or PhD in Mathematics.

• Proficient Python programming skills with a background in scientific computing.

• Experience with scientific Python libraries such as NumPy, SciPy, SymPy, or other relevant domain-specific tools.

• Capability to formulate rigorous mathematical problems with clear constraints and expected outputs.

• Experience in implementing scientific or mathematical solutions with unit tests and deterministic outputs.

• Previous experience in AI data annotation, scientific research, or scientific writing.

• Familiarity with LLM evaluation frameworks, coding benchmarks, or assessments of AI-generated code.

• Published research or academic project experience in mathematics or another STEM field.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Opportunities for professional development and continuing education.

• Supportive and collaborative work environment.

• Flexible work hours and remote work options.