Senior Machine Learning Engineer

This is a fully remote position, open to applicants in Massachusetts.

📋 Description

• Design and conduct experiments aimed at enhancing agent quality through improved tool usage, reasoning, and output quality, utilizing frameworks such as DSPy and VLLM.

• Develop and sustain evaluation infrastructure to assess effectiveness and identify regressions prior to customer detection.

• Optimize LLM inference, focusing on latency, cost, model routing, and quality trade-offs.

• Collaborate with product teams on model selection and performance benchmarking.

• Work closely with product engineers and PMs to convert customer quality issues into ML hypotheses and actionable solutions.

• Manage models throughout their lifecycle: from research and experimentation to deployment in production.

⛳️ Requirements

• A minimum of 5 years of experience in a dedicated ML Engineer role (not in ML-adjacent software engineering).

• Proficient in Python; experience with PyTorch, VLLM, DSPy, or similar frameworks for LLM optimization.

• Practical experience with large language models in a production setting, including prompt engineering, fine-tuning, evaluation, and inference optimization.

• Ability to transition from vague problems (e.g., 'this agent isn't performing well') to experimental design and implemented improvements.

• Comfortable working with minimal supervision within an early-stage product environment.

🏝️ Benefits

• Equity plan available for eligible positions.

• Annual bonus targets as part of the bonus plan for eligible positions.