Senior Data Scientist – Model Evaluation

This is a fully remote position, open to applicants in United States, +1 more state.

📋 Description

• Contribute to the evaluation of models across various football-related applications.

• Lead one or two evaluation initiatives from start to finish.

• Develop and enhance tools for testing, comparing, and deploying models.

• Collaborate with football experts to create realistic evaluation frameworks.

• Identify and address silent regressions prior to model deployment.

• Question and refine metrics that fail to reflect their intended objectives.

• Create an experimentation platform to rapidly test new ideas.

⛳️ Requirements

• Solid grounding in statistical principles.

• Familiarity with calibration (both reliability and resolution), bootstrapping, and inter-rater reliability.

• Proven experience in contributing to model evaluation within a production machine learning team.

• Experience with production ML pipelines.

• Knowledge of schema drift, label noise, and data leakage.

• Capable of developing tools rather than solely utilizing them.

• Self-motivated individual who can take strategic guidance and forge their own direction.

• AI-native mindset towards skill development, feedback loops, and tool creation.

• Keeps up-to-date with the latest research, publications, releases, and methodologies.

• Ability to understand and become proficient in complex subject areas.

🏝️ Benefits

• Competitive salary and bonus structure.

• Comprehensive health insurance coverage.

• 401k retirement savings plan with company matching contributions.

• Flexible remote work environment.

• Unlimited time off policy with flexibility.

• Generous paid holiday schedule, totaling 13 days, including the Monday after the Super Bowl.

• Annual performance-based bonus.

• Additional benefits and/or incentive compensation plans applicable.