
Data Scientist
Posted Jul 28

Posted Jul 28
This is a fully remote position, open to applicants in United States.
• Develop comprehensive, task-oriented evaluation criteria for real-world data science outputs, which include:
• - Data analyses
• - Predictive and statistical models
• - Dashboards and visualizations
• - Experiment outcomes
• - Executive recommendations and business insights
• Assess both AI-generated and human-produced work using objective scoring frameworks.
• Deliver detailed written justifications for each evaluation to ensure consistency and technical precision.
• Utilize sound analytical judgment to generate reproducible and defensible assessments.
• Integrate structured reviewer feedback and continuously enhance evaluation methodologies.
• Work collaboratively with cross-functional teams to elevate AI training quality and evaluation standards.
• Over 5 years of professional experience in Data Science within an industry setting.
• Strong foundation in business operations, product analytics, growth analytics, or related data science roles at technology-focused organizations.
• Extensive knowledge in:
• - Experimental design and A/B testing
• - Statistical analysis
• - SQL and Python
• - Metric development and performance assessment
• - Converting analytical insights into business recommendations
• Outstanding written communication skills with the capability to articulate technical reasoning clearly.
• Exceptional attention to detail and the ability to consistently evaluate work against structured criteria.
• Comfortable receiving feedback and adjusting evaluation standards in collaboration with peer reviewers.
• Experience in contributing to AI evaluation, model training, human feedback, or data annotation projects. (Preferred)
• Knowledge of large language models (LLMs), AI-assisted analytics, or machine learning workflows. (Preferred)
• Experience in reviewing technical work or mentoring analytical teams is an advantage. (Preferred)
• Competitive salary and performance-based bonuses.
• Flexible work hours and remote work options.
• Opportunities for professional development and training.
• Comprehensive health and wellness benefits.
• Collaborative and innovative work environment.
Paramount
DMS International
DocPlanner
Get handpicked remote jobs straight to your inbox weekly.