Senior Machine Learning Engineer

📋 Description

• Design, develop, and implement features for LLM-powered products, such as lab result summaries, clinical workflow tools, and conversational agents for practitioners.

• Create backend services that integrate LLMs and ML models into Fullscript’s platform, primarily utilizing Python, with an increasing focus on Elixir as the platform matures.

• Build AI systems capable of addressing open-ended clinical inquiries, managing follow-up interactions, and reasoning over both structured and unstructured healthcare contexts.

• Execute strategies for prompting, grounding, retrieval, and safety that enhance output quality, consistency, and clinical relevance.

• Develop evaluation, testing, monitoring, and CI/CD workflows for AI features, including methods for assessing accuracy, detecting hallucinations, managing edge cases, and ensuring reliability.

• Collaborate with medical, product, analytics, and engineering teams to convert clinical requirements into scalable AI solutions.

• Oversee AI systems from inception to production, encompassing experimentation, prototyping, deployment, iteration, and continuous enhancement.

• Participate in architectural and implementation decisions for AI-driven analytics, lab interpretation, and clinical decision-support workflows.

• Stay updated with the rapidly evolving LLM, agentic AI, and applied ML landscapes while maintaining a realistic perspective on what is suitable for production use.

⛳️ Requirements

• 5+ years of experience in machine learning engineering, applied AI engineering, backend engineering, or a related field, with a proven history of delivering production systems.

• 2+ years of recent practical experience in developing LLM-powered applications, including conversational agents, RAG workflows, tool utilization, or agentic systems.

• Strong backend development skills in Python, with a solid foundation in SQL and comfort in handling data-intensive product environments.

• Proficient in integrating LLMs such as OpenAI, Gemini, Anthropic, or similar models into user-facing applications.

• Familiarity with LLM application frameworks or orchestration tools like LangChain, LangGraph, Hugging Face tools, or equivalent frameworks.

• Strong engineering practices, including version control with Git, testing, CI/CD, observability, evaluation, and production monitoring.

• Experience in assessing and validating LLM-based applications for quality, hallucinations, correctness, edge cases, and long-term reliability.

• Capability to work independently in ambiguous situations, ask insightful questions, make sound trade-offs, and effectively collaborate with technical, product, medical, and non-technical stakeholders.

• Bonus if you possess: Experience with Elixir, Phoenix, functional programming, or a keen interest in building with Elixir as Fullscript’s AI platform evolves.

• Bonus if you have: Experience in developing AI assistants, conversational agents, or decision-support tools within healthcare, clinical workflows, regulated products, or other high-trust settings.

• Bonus if you are familiar with MCP, Langfuse, agent orchestration patterns, tool-calling systems, or multi-step AI workflows.

🏝️ Benefits

• Flexible PTO and competitive compensation, because work-life balance is essential.

• RRSP/401k matching and stock options to help you invest in your future.

• Comprehensive benefits package with customizable coverage, paramedical services, and a Health Spending Account (HSA).

• Discounts on high-quality wellness products through Fullscript.

• Opportunities for continuous learning to enhance your skills and career development.

• Remote-first flexibility to work in your preferred environment, with Ottawa, Toronto, or Calgary being the preferred locations for this role.