Senior AI Engineer, Agentic Platform

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Transform customer requirements into production AI agents, endpoints, tools, and user experiences.

• Develop production agents and tools for retrieval, multi-step workflows, and actions on Amazon Bedrock, utilizing Bedrock AgentCore and MCP.

• Translate semantic-layer and service-API functionalities into efficient agent endpoints and tools.

• Influence answer speed, confidence, explanations, and subsequent steps.

• Construct evaluation harnesses with labeled test sets, groundedness and hallucination metrics, and continuous integration regression gates.

• Assess adoption, feedback, intent, task success, and decision quality; communicate impact to Product and the business.

• Implement tracing, diagnose failure modes, apply fixes, and iterate.

• Take ownership of MCP endpoints, latency, response costs, caching, runtime guardrails, deployment, and testing.

• Collaborate with Product Managers and engineers on decisions supported by agents.

• Suggest and lead data or infrastructure modifications with the platform team.

⛳️ Requirements

• Over 5 years of experience in developing production software or data-intensive systems for real customers.

• Proficient in Python.

• At least one LLM or agent feature deployed to production users.

• Practical AWS experience; familiarity with Amazon Bedrock and Bedrock AgentCore is a plus.

• Background in agent orchestration, tool and function design, context assembly, and multi-step workflows.

• Experience in building retrieval systems over actual business data.

• Proficient in SQL and metrics.

• Experience in constructing or managing an evaluation loop for a generative system, including labeled sets and regression gates.

• Strong product sense for AI, including determining when an agent should respond, inquire, or decline, and how it should present its reasoning.

• Proven ability to quantify agent adoption, task success, and decision quality.

• Familiarity with utilizing coding agents in a real production environment.

• Ability to differentiate between correct outputs and outputs that are merely plausible.

• Exceptional communication and collaboration abilities.

• Applicants must have the legal right to work in the UK.

• Must be able to work remotely from the UK.

• No visa sponsorship available.

🏝️ Benefits

• Competitive company pension scheme with employer matching.

• Generous holiday allowance/flexible time off plus UK bank holidays.

• Enhanced maternity, paternity, and parental leave policies.

• Continuous learning resources.

• Comprehensive Employee Assistance Programme (EAP) offering free 24/7 mental health, legal, and financial guidance.

• Flexible and collaborative work environment.

• Occasional team collaboration meetups.