
Principal Data Scientist, Agentic AI Technical Lead
Posted 11 hours ago

Posted 11 hours ago
This is a fully remote position, open to applicants in Canada.
β’ Oversee the technical aspects of all agentic AI workstreams, from problem identification and design to evaluation, deployment, and ongoing operations.
β’ Develop technical strategies and reference architectures for agentic systems, such as multi-agent orchestration, tool and function calling, RAG patterns, vector databases, embeddings, and streaming responses.
β’ Manage the technical delivery across various streams, addressing obstacles and coordinating dependencies.
β’ Establish standards for model development, experimentation, and processes that transition research to production.
β’ Create evaluation frameworks for LLM and agent performance, focusing on quality, safety, hallucination, cost, and latency.
β’ Guide the development of scalable ML platforms, pipelines, and workflow orchestration for event-driven, asynchronous operations.
β’ Ensure the reliability, security, scalability, observability, monitoring, and debugging of production systems.
β’ Act as the technical representative of the AI/ML program to senior client stakeholders.
β’ Collaborate with executive leadership to co-define the AI roadmap.
β’ Simplify complex technical concepts for executive, engineering, and business audiences.
β’ Align data science, engineering, product, and business teams around common priorities and measurable outcomes.
β’ Lead and influence a large, multi-team delivery organization.
β’ Define and advocate for data science and AI engineering standards.
β’ Review and enhance work quality across teams.
β’ Mentor technical leads and senior practitioners.
β’ Make critical, program-wide technical decisions.
β’ Drive the long-term technical vision for the agentic AI practice.
β’ Over 12 years of experience in data science and AI/ML.
β’ Proven history of transitioning AI systems from research to production at an enterprise scale.
β’ Demonstrated ability to lead technical delivery across multiple concurrent workstreams or teams.
β’ Experience in leading or technically overseeing large, multi-team programs, including managing technical risks, dependencies, and ensuring delivery quality.
β’ Exceptional skills in stakeholder management and communication, with established credibility among senior executives and client leadership.
β’ Practical experience with LLM and agentic systems, including prompt engineering, function/tool calling, multi-agent orchestration, RAG architectures, vector databases, embeddings, and streaming LLM responses.
β’ Extensive knowledge in model evaluation, experimentation design, and applied statistics, including evaluation methods for generative and agentic systems.
β’ Strong command of Python and the modern data science and ML stack.
β’ Expertise in MLOps and AI infrastructure, encompassing model versioning, monitoring, deployment automation, and reproducibility.
β’ Solid foundations in software engineering, including system design, API design, code quality, and unit testing practices.
β’ Experience with distributed systems, event-driven architectures, and workflow orchestration tools.
β’ Comprehensive familiarity with AWS, particularly Amazon Bedrock; working knowledge of other cloud platforms is a plus.
β’ Understanding of SQL and NoSQL databases, including scalable design patterns.
β’ Working knowledge of AI governance, responsible AI, and compliance considerations in production environments.
β’ Experience supporting AI programs in regulated industries such as life sciences, healthcare, or financial services.
β’ Background in consulting or client-facing technical leadership roles.
β’ Experience in fine-tuning, evaluation automation, or ensuring agent safety and guardrails.
β’ Production-ready AI delivered within 30 to 45 days.
β’ Opportunity to engage with AI systems that integrate into enterprise operations.
β’ Chance to collaborate with experienced teams averaging over fifteen years of expertise.
Capital One
Fundraise Up
MUTT DATA
Sport Alliance GmbH
Get handpicked remote jobs straight to your inbox weekly.