
Data Science, Quantitative AI Evaluation Specialist
Posted 5 days ago

Posted 5 days ago
This is a fully remote position, open to applicants in United States, +4 more countries.
• Assess AI-generated outputs in areas such as data science, statistics, machine learning, experimentation, and quantitative problem-solving.
• Develop expert-level prompts, datasets, and reference solutions aimed at AI training and evaluation.
• Detect flawed methodologies, statistical errors, unsupported assumptions, and weaknesses in quantitative reasoning.
• Evaluate the accuracy, reliability, and clarity of analytical methods and conclusions.
• Deliver structured, evidence-based feedback to enhance AI model performance.
• Implement consistent evaluation criteria and convey technical findings effectively.
• Minimum of one year of experience at a leading company in tech, finance, or research, alongside a total of three years of experience in Data Science or Software Engineering.
• Bachelor’s degree in Data Science, Software Engineering, or a related discipline from an accredited university in the United States, Canada, Australia, New Zealand, or the United Kingdom.
• Fundamental understanding of data science, statistics, machine learning, or quantitative analysis.
• Strong analytical and critical thinking abilities, with a keen eye for identifying errors in data-driven reasoning.
• Exceptional written English skills, with the capacity to clearly articulate technical and statistical concepts.
• Proficiency in systematically evaluating complex problems and providing accurate, well-supported feedback.
• Must currently reside in an English-speaking country.
• Comprehensive health and wellness benefits.
• Opportunities for professional development and growth.
• Flexible work arrangements and a supportive work environment.
Clear Street
The Cigna Group
IDS Comercial
Just Eat Takeaway.com
Get handpicked remote jobs straight to your inbox weekly.