Senior Machine Learning Engineer

This is a fully remote position, open to applicants in Canada.

📋 Description

• Design, develop, and implement product features powered by LLMs, such as lab result summaries, clinical workflow tools, and conversational agents for practitioners.

• Create backend services that incorporate LLMs and machine learning models into Fullscript’s platform, primarily using Python, with an increasing focus on Elixir as the platform matures.

• Construct AI systems capable of addressing open-ended clinical inquiries, facilitating follow-up interactions, and reasoning across both structured and unstructured healthcare contexts.

• Execute prompting, grounding, retrieval, and safety strategies to enhance output quality, consistency, and clinical relevance.

• Develop evaluation, testing, monitoring, and CI/CD workflows for AI features, including methods for assessing accuracy, detecting hallucinations, handling edge cases, and ensuring reliability.

• Collaborate with medical, product, analytics, and engineering teams to transform clinical requirements into scalable AI solutions.

• Manage AI systems comprehensively, from experimentation and prototyping to production deployment, iterative improvements, and ongoing enhancement.

• Contribute to architectural and implementation decisions for AI-driven analytics, lab interpretations, and clinical decision-support workflows.

• Keep abreast of the rapidly evolving LLM, agentic AI, and applied ML landscapes, while maintaining a pragmatic approach to production readiness.

⛳️ Requirements

• Over 5 years of experience in machine learning engineering, applied AI engineering, backend engineering, or a related field, with a proven history of delivering production systems.

• At least 2 years of recent hands-on experience in creating LLM-powered applications, including conversational agents, RAG workflows, tool utilization, or agentic systems.

• Proficient in backend development with Python, possessing solid SQL fundamentals and comfortable navigating data-intensive product environments.

• Experience in integrating LLMs such as OpenAI, Gemini, Anthropic, or comparable models into user-facing products.

• Familiarity with LLM application frameworks or orchestration tools such as LangChain, LangGraph, Hugging Face tools, or similar systems.

• Strong engineering practices, including expertise in Git, testing, CI/CD, observability, evaluation, and production monitoring.

• Experience in evaluating and validating LLM-based applications for quality, hallucinations, accuracy, edge cases, and long-term reliability.

• Ability to operate independently in uncertain problem domains, pose insightful questions, make sound trade-offs, and collaborate effectively with technical, product, medical, and non-technical stakeholders.

• Bonus if you have: Experience with Elixir, Phoenix, functional programming, or an interest in building with Elixir as Fullscript’s AI platform progresses.

• Bonus if you have: Experience developing AI assistants, conversational agents, or decision-support tools in healthcare, clinical workflows, regulated products, or other high-trust settings.

• Bonus if you have: Knowledge of MCP, Langfuse, agent orchestration patterns, tool-calling systems, or multi-step AI workflows.

🏝️ Benefits

• Flexible PTO and competitive compensation, as work-life balance is important.

• RRSP/401k matching and stock options to support your future investments.

• Comprehensive benefits package with customizable coverage, paramedical services, and an HSA.

• Discounts on high-quality wellness products through Fullscript.

• Opportunities for continuous learning to enhance your skills and career.

• Remote-first flexibility to work in your preferred environment, with Ottawa, Toronto, or Calgary as preferred locations for this role.