Senior ML Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct experiments aimed at enhancing classification accuracy and successfully implement effective strategies into production.

• Create and refine classifiers to assess products against eligibility criteria through prompting, retrieval, fine-tuning, and multi-model methodologies.

• Investigate misclassifications, pinpoint failure modes, and establish subsequent experimental plans.

• Develop and expand evaluation sets and metrics, including ground-truth labeling.

• Monitor new models and research, testing alternatives that could enhance accuracy or reduce costs.

• Broaden classification coverage to include new product categories.

• Identify and prototype innovative applications for models and data beyond the realm of product classification.

• Collaborate with clinical operations and legal teams to translate eligibility criteria into labeled data and verifiable system actions.

• Document findings and promote AI fluency throughout the engineering teams.

⛳️ Requirements

• A minimum of 5 years of engineering or applied research experience.

• At least 2 years of practical experience working with LLMs or other machine learning models on real-world challenges.

• Proven history of conducting rigorous experiments, including well-defined hypotheses, robust baselines, ablation studies, and substantiated conclusions.

• Proficiency in designing evaluation methodologies for AI systems.

• Practical experience with prompting, fine-tuning, retrieval, or agent design on foundational models.

• Strong command of Python programming.

• Sufficient engineering expertise to elevate an experiment to production status.

• Senior-level accountability for navigating ambiguous machine learning problems from initial experimentation through to production.

• Public documentation of experimental work, such as publications, open-source machine learning contributions, or technical papers.

• Experience in healthcare or regulatory classification, or multi-model orchestration is a plus.

🏝️ Benefits

• Stock options.

• Comprehensive medical, dental, and vision insurance.

• Employer-sponsored HSA contributions.

• 401(k) plan.

• Unlimited paid time off (PTO).

• Remote work opportunities.

• Coworking stipend.

• Learning and Development (L&D) stipend.

• Biannual company offsites.

• Biannual team offsites.