Senior Machine Learning Engineer, Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Act as the inaugural ML hire in the Platform Engineering team, reporting directly to the Head of Platform Engineering.

• Take full responsibility for the lifecycle of extraction models, including framing, data and annotation strategy, model selection, training/fine-tuning, evaluation, deployment, monitoring, and retraining.

• Collaborate with clinical and customer-facing stakeholders to define what constitutes “accurate enough.”

• Create the evaluation harness as a primary deliverable.

• Work alongside Clinical Data Managers to design curation strategies.

• Oversee the technical aspects of QA/QC, which includes making extractability decisions, establishing model specifications, developing tooling, sampling, and conducting error analysis for human-in-the-loop review.

• Develop clinical NLP pipelines utilizing messy real-world data.

• Collaborate with backend engineers to implement ML systems into production.

• Design and rigorously assess LLM solutions using versioned prompts, tracking of costs and latency, and failure-mode analysis.

• Communicate extraction quality in a way that is understandable to colleagues without an ML background.

• Manage de-identification, PHI, audit trails, and access controls as integral parts of the modeling problem.

• Contribute to shaping the roadmap and potentially lead the future team.

⛳️ Requirements

• Experience in healthcare or life sciences with real clinical data — including clinical notes, EHR data, claims, registries, or similar; this is non-negotiable.

• Over 6 years of experience in applied ML.

• Proven track record of taking models from problem statement to production and maintaining them.

• Extensive knowledge in applied ML on text, particularly in information extraction, NER, classification, sequence labeling, weak supervision, annotation guidelines, and inter-annotator agreement.

• Hands-on experience with LLM-based methods, including prompt development, structured output, retrieval, fine-tuning when necessary, evaluations, and observability.

• Strong foundational skills in Python programming.

• Experience in production engineering beyond the use of notebooks.

• Capable of defining problems with stakeholders, writing clearly, and collaborating across the ML domain.

• Self-motivated problem solver with the ability to work independently without a predefined playbook.

• Preferred: Familiarity with SNOMED CT, ICD-10, LOINC, RxNorm, CPT, FHIR.

• Preferred: Knowledge of HIPAA, SOC 2, de-identification methodologies, IRB, or experience with regulatory-grade data.

• Preferred: Experience as an early or first ML hire.

• Preferred: Experience with human-in-the-loop annotation and QC operations at scale.

• Preferred: Background in OCR and document-understanding technologies.

• Preferred: Experience in mentoring or leading ML engineers.

• Applicants must reside in the United States.

• Novellia is currently unable to sponsor visas.

🏝️ Benefits

• Equity in Novellia.

• Comprehensive medical, dental, and vision coverage.

• 401(k) plan.

• Flexible time off policy.

• Wellness stipend.

• Up to 12 weeks of parental leave.