ML Engineer

This is a fully remote position, open to applicants in California.

📋 Description

• Deploy and oversee machine learning systems in production, encompassing traditional NLP and embedding models as well as features powered by large language models (LLMs).

• Take ownership of the evaluation framework, including golden datasets, "model-as-a-judge" systems, inter-annotator agreement, and regression tests that determine release readiness.

• Develop and sustain our vector embeddings ecosystem, along with the retrieval, classification, and similarity methodologies that operate on top of it.

• Collaborate with the Data Science team on annotation processes, PII scrubbing, and ground-truth pipelines.

• Enhance our MLOps infrastructure, focusing on version control, observability, and drift detection.

• Convert ambiguous product challenges into quantifiable AI features with defined success metrics.

⛳️ Requirements

• 4–7 years of relevant experience in software or machine learning engineering, with at least 2 years of experience in deploying ML systems to production.

• Proficient in Python; familiarity with the contemporary data and ML technology stack.

• Practical experience in deploying and monitoring models on at least one major cloud platform (AWS or GCP), and an eagerness to learn the other.

• Experience with production-grade NLP or ML systems, including classification, named entity recognition (NER), embeddings, ranking, similarity, or features powered by LLMs.

• Hands-on experience with evaluation methods for ML or LLM systems, such as golden datasets, model-as-a-judge, inter-annotator agreement, precision/recall, or similar methodologies.

• A collaborative communicator who works effectively with data scientists and engineers, capable of articulating ideas, requirements, and trade-offs to non-technical stakeholders.

🏝️ Benefits

• People: collaborate with skilled, friendly, and cooperative individuals who are passionate about their work.

• Guidance: leverage our learning platform to receive comprehensive training and tools needed for success from day one.

• Surprise meal stipends: enjoy the pleasure of someone else cooking for you, even while working from home!

• Work/life harmony: enjoy 15 vacation days, a mix of floating and designated holidays, wellness allowance, and paid parental leave.

• Whole Health Package: includes medical, dental, vision, life, and disability insurance, among other benefits.

• Savings: benefit from a 401k (USA) plan designed to help you prepare for the future.

• Work from home stipend: receive assistance in creating an effective home office (or use it for a new dog leash – your choice!).