
Manager, Applied AI Science β Healthcare
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in Canada.
β’ Oversee, guide, and nurture a small team of Applied AI Scientists while offering technical and scientific direction throughout their projects.
β’ Create, enhance, and optimize reusable AI capabilities utilizing machine learning, large language models, retrieval-augmented generation, AI agents, and other sanctioned enterprise AI technologies.
β’ Develop solutions that integrate models, prompts, context, retrieval, tools, structured outputs, human review, and workflow integration for specified intended applications.
β’ Plan and carry out evaluations using representative datasets, reference standards, performance metrics, acceptance criteria, and statistical techniques.
β’ Establish expected behavior, evaluate outputs and potential failure modes, assess uncertainties and limitations, and suggest enhancements based on evaluation findings.
β’ Generate maintainable Python code, analytical workflows, evaluation tools, and reusable software components that support AI development and testing.
β’ Work collaboratively with AI Architecture, Product Management, application teams, subject matter experts, Quality, and Governance.
β’ Remain informed about developments in artificial intelligence, machine learning, statistics, and evaluation methodologies.
β’ Contribute to the ongoing evolution of practices within the AI Center of Excellence.
β’ Recruit, mentor, supervise, and evaluate the performance of 2β5 Applied AI Scientists.
β’ A Master's degree in Computer Science, Data Science, Statistics, Biomedical Engineering, Applied Mathematics, Computer Engineering, or a closely related quantitative field.
β’ A Bachelor's degree in a relevant quantitative discipline with considerable applied AI, machine learning, or statistical experience will also be considered.
β’ A minimum of 5 years of experience in developing AI, machine learning, data science, or applied AI solutions in practical settings.
β’ Experience in Healthcare/CRO is essential.
β’ Familiarity with GxP, 21 CFR Part 11, HIPAA, GDPR, software validation, or other related regulated-system standards.
β’ Strong programming proficiency in Python, R, or a similar language.
β’ Experience in mentoring technical personnel, guiding scientific initiatives, or providing technical leadership across projects.
β’ Proven experience in applying statistical methods, experimental design, or performance analysis to intricate technical issues.
β’ Experience in defining AI evaluation metrics, assessing AI control effectiveness, and developing monitoring strategies for AI system performance and risk.
β’ Proven collaboration skills with software engineers, architects, product teams, and business stakeholders throughout the AI development lifecycle.
β’ Comprehensive understanding of statistics, experimental design, sampling, machine learning, model validation, uncertainty, bias, and generalizability.
β’ Experience in developing capabilities using large language models, retrieval-augmented generation, prompt and context design, AI agents, tool integration, and structured outputs.
β’ Experience in creating evaluation datasets and reference standards, selecting appropriate metrics, defining acceptance criteria, and analyzing performance and failure modes.
β’ Strong programming capabilities with the ability to develop maintainable analytical software, AI functionalities, and evaluation tools.
β’ Understanding of how models, data, retrieval, prompts, tools, human review, and workflow context collaborate to influence AI system behavior.
β’ Capability to document and convey evaluation methods, assumptions, results, uncertainties, limitations, and recommendations effectively.
β’ Ability to connect technical decisions to enterprise architecture, long-term reuse, scalability, and business strategy.
β’ Skill in translating operational requirements and workflows into structured AI capabilities and measurable evaluation queries.
β’ Advanced problem-solving ability to address complex architecture and engineering challenges through practical and sustainable solutions.
β’ Proficient in articulating architectural concepts, trade-offs, and recommendations clearly to executives, engineers, scientists, architects, and business stakeholders.
β’ Capacity to work efficiently across Product Management, AI Science, Application Development, Platform Engineering, DevOps, Security, Data, Quality, and business teams.
β’ Ability to assess emerging technologies and adapt architectural direction while upholding engineering discipline and operational reliability.
β’ Competitive salaries.
β’ Opportunities for professional advancement.
β’ RRSP with company matching.*
β’ Tuition reimbursement.
β’ Flexible work environment.
β’ Discretionary Paid Time Off (PTO).
β’ Paid holidays.
β’ Employee assistance programs.
β’ Medical, dental, and vision coverage.
β’ Telemedicine (virtual doctor appointments).
β’ Wellness program.
β’ Adoption assistance.
β’ Short-term disability.
β’ Long-term disability.
β’ Life insurance.
β’ Discount programs.
anni.care
InnoData
Mercor
Mercor
Get handpicked remote jobs straight to your inbox weekly.