Evaluation and ML Systems Engineer, AI Safety and Security Engineering

This is a fully remote position, open to applicants in California, +4 more states.

📋 Description

• Develop the benchmarking and reproducibility frameworks that are essential to our operations.

• Establish the metrics and protocols we utilize for evaluation.

• Associate every outcome with the code and executions that generated it.

• Ensure that findings are reviewable and that conclusions are traceable.

⛳️ Requirements

• A Bachelor's degree (or equivalent experience) accompanied by over 5 years in ML engineering or evaluation.

• Experience in designing benchmarks, metrics, and statistically robust comparisons for ML systems.

• A meticulous and critical mindset towards metrics, baselines, and assertions.

• Proficient in Python engineering for collaborative infrastructure, including experiment tracking and data pipelines.

🏝️ Benefits

• Competitive salaries

• Generous benefits package

• Equity