Director, AI Platform Engineering

This is a fully remote position, open to applicants in Texas.

📋 Description

• Oversee the Enterprise AI Platform Engineering division at BMO

• Take ownership of the AI Gateway, Policy Engine, Identity Fabric, AI Registry, Guardrails Runtime, and AI Observability

• Design, implement, and manage control and orchestration infrastructure for enterprise AI workloads

• Productionize the developer portal and create a federated AI Registry with self-service onboarding and lifecycle workflows

• Develop policy-as-code infrastructure, including policy compilation, GitOps distribution, approval workflows, and policy simulation

• Provide operational, security, and compliance telemetry pipelines with trace correlation and tamper-evident audit evidence

• Implement certification workflows, compliance scoring, decommission governance, and evidence generation

• Deploy gateway runtime across various cloud environments, incorporating policy evaluation, routing, residency, budget/quota controls, and circuit breakers

• Develop a multi-stage Guardrails Runtime that addresses moderation, prompt-injection defense, PII management, output validation, hallucination detection, and policy enforcement

• Create workload identity, token exchange, trust boundaries, enterprise identity integration, and cross-cloud token federation

• Deliver initial platform capabilities, including a production-ready portal and registry, operational AI Gateway, policy infrastructure, and runtime evidence pipeline

• Expand the team from an initial size of 8–12 FTE through recruitment and the reallocation of internal engineers

• Collaborate with Security, Architecture, DevOps, domain teams, fellow Directors, and senior leadership

• Manage the operation of what the team develops without a separate run team, ensuring design for operability and regulatory compliance

⛳️ Requirements

• 8+ years of experience in technical platform, infrastructure, or AI/ML engineering roles within a large enterprise

• 4+ years of experience in leading and managing engineering teams

• Proven experience in building and scaling engineering teams, including workforce planning, hiring, succession planning, and squad structuring

• Ability to integrate new hires with reallocated and seconded internal engineers

• Strong track record in mentoring and coaching

• Experience in fostering an inclusive team culture aligned with BMO Values

• Proven experience in navigating change and ambiguity

• Skills in conflict resolution and cross-team influence

• Experience in building and operating platform capabilities at scale

• In-depth knowledge of GenAI platform engineering, including LLM/AI gateways, model routing, RAG, agentic patterns, guardrails, and AI evaluation

• Practical experience with policy-as-code and authorization systems such as Cedar or OPA/Rego, along with GitOps distribution

• Familiarity with workload identity and zero-trust patterns, including SPIFFE/SPIRE, mTLS, token exchange, and federated identity

• Strong background in observability engineering, including OpenTelemetry, distributed tracing, and telemetry pipelines

• Proficiency in multi-cloud environments; AWS and Azure preferred

• Knowledge of cloud-native architecture, containerization/Kubernetes, and Infrastructure as Code

• Familiarity with Bedrock, Azure OpenAI, SageMaker, Databricks, MLflow, LangChain, or similar technologies

• Proven experience in CI/CD, DevSecOps, and MLOps/LLMOps delivery

• Understanding of Responsible AI, AI/data governance, and privacy

• Excellent executive communication and relationship management skills

• Strong strategic and organizational management abilities, including roadmap planning, budgeting, forecasting, and vendor engagement

• Exceptional analytical, problem-solving, and prioritization skills

• Bachelor's degree in Computer Science, Software Engineering, or a related technical field

🏝️ Benefits

• Performance-based incentives

• Discretionary bonuses

• Health insurance

• Tuition reimbursement

• Accident and life insurance

• Retirement savings plans

• Comprehensive training and coaching

• Support from management

• Opportunities for networking

• Tools and resources for professional development