ML Lead, AI Data Labeling

This is a fully remote position, open to applicants in United States.

📋 Description

• Act as the main technical liaison for machine learning, applied science, and product teams within AI-driven client organizations.

• Engage confidently in technical discussions.

• Convert unclear technical requirements into definitive operational specifications.

• Develop and establish domain benchmarks for NewtonX-owned sectors in high-value industries.

• Collaborate closely with the recruiting and operations lead to transform client and benchmark needs into operational specifications.

• Participate in client calls in conjunction with Commercial leads.

⛳️ Requirements

• 5 to 8 years of practical machine learning experience, particularly in evaluation, benchmarking, or working with human data.

• Proficient understanding of contemporary LLM evaluation, including benchmark design, contamination management, statistical significance, evaluation harness construction, agentic and tool-use assessment, RLHF, preference data quality, and red-team probe design.

• Solid programming skills. You should be able to comprehend an evaluation harness, write Python with ease, interact with model APIs, and develop scoring pipelines.

• Strong grasp of statistics. You can distinguish between real effects and mere noise.

• Proven experience in client-facing roles.

• Basic commercial awareness.

• Exceptional written communication abilities.

🏝️ Benefits

• Outstanding medical, dental, and vision coverage.

• 401k matching program with immediate vesting.

• Health savings/flexible spending accounts and pre-tax commuter benefits.

• Paid time off for vacation, holidays, sick leave, and parental leave.

• A diverse, collaborative, and positive work culture where we foster and celebrate each other's achievements (including happy hours, team projects, and retreats).