
Senior Software Engineer – AI Infrastructure
Posted Jun 5

Posted Jun 5
This is a fully remote position, open to applicants in United Kingdom.
• Design and construct the infrastructure layer that powers AI agent systems in a production environment.
• Create high-performance Rust services responsible for model inference, orchestration, and execution.
• Architect scalable systems that can accommodate millions of users and achieve high request throughput.
• Develop dependable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring.
• Establish guardrails, observability, and failure management for workflows driven by agents.
• Enhance latency, throughput, and cost efficiency across inference and orchestration layers.
• Collaborate closely with the Agent Systems team to evolve experimental prototypes into robust production systems.
• Contribute to key infrastructure decisions in a high-scale, impactful environment.
• Over 5 years of experience in building and managing high-scale production systems.
• Strong expertise in Rust and systems-level programming.
• Profound knowledge of distributed systems, reliability engineering, and performance optimization.
• Experience in operating services that cater to millions of users or manage high-throughput workloads.
• Familiarity with ML infrastructure, model serving, or MLOps in production settings.
• Proven experience in designing observability, monitoring, and failure recovery systems.
• Excellent collaboration skills when working with both infrastructure and applied engineering teams.
• A strong ownership mentality in high-stakes production environments.
• Health insurance
• 401(k) matching
• Flexible work hours
• Paid time off
• Remote work options
Thermo Fisher Scientific
OdysseyRe
Flourish Health
Get handpicked remote jobs straight to your inbox weekly.