
AI Operations Lead
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in United Kingdom.
• Supervise the daily functions of the AI gateway, which includes model routing, rate limiting, cataloging, fallback pathways, and access permissions.
• Develop and maintain low-code automations that integrate enterprise applications with sanctioned AI services.
• Transform manual processes into secure, auditable workflows that include human oversight.
• Configure, test, and deploy AI agents along with Model Context Protocol (MCP) connections.
• Implement least-privilege access across agent knowledge bases.
• Observe production behavior to ensure security and mitigate hallucinations.
• Uphold AI governance policies throughout models, agents, and workflows.
• Maintain audit trails and assist legal, risk, and privacy teams with AI impact assessments and data residency evaluations.
• Monitor token utilization, API expenditures, and usage budgets.
• Establish quotas and alert thresholds to optimize usage and ensure budget adherence.
• Manage access requests, incidents, and operational modifications.
• Keep runbooks updated, handle vendor SLAs, and resolve platform-related issues.
• Train and enhance the capabilities of internal teams regarding prompt structures and responsible AI tools.
• Cultivate a company-wide Community of Practice.
• Lead process automation initiatives, manage vendor relationships, and drive internal AI adoption efforts.
• Demonstrated experience in technology operations, platform administration, application support, or service management.
• Practical experience with administering AI platforms/gateways (such as LiteLLM) or SaaS automation tools (like n8n, Make, Power Automate).
• Strong knowledge of REST APIs, webhooks, JSON structures, RBAC, and secret management.
• Familiarity with cloud AI providers (e.g., Amazon Bedrock, Anthropic) and fundamental GenAI concepts (like tokens, context windows, and embeddings).
• Proven incident management, system documentation, and operational control skills.
• Exceptional communication skills, capable of connecting technical concepts with business objectives.
• Experience in ITIL-compliant or highly regulated, security-sensitive environments.
• Exposure to Model Context Protocol (MCP), LLM observability tools (such as Langfuse, Datadog), or AWS infrastructure.
• Basic scripting abilities in Python or JavaScript for troubleshooting and data mapping purposes.
• Knowledge of AI governance frameworks (e.g., ISO/IEC 42001, NIST AI RMF) or information security standards (like ISO 27001, SOC 2).
• Relevant AWS Cloud or AI Governance certifications.
• Generous holiday allowance.
• Flexible working hours.
• Option to buy and sell holidays.
• Enhanced maternity pay.
• Complimentary breakfast, fruit, and beverages.
• Regular social events.
• Strong emphasis on work-life balance.
• Comprehensive training and support to ensure success and ongoing career development.
CareMetx, LLC
Zocdoc
Get handpicked remote jobs straight to your inbox weekly.