Senior Software Engineer, Agent Infrastructure

This is a fully remote position, open to applicants in Canada, +1 more country.

📋 Description

• Develop the next generation of agentic AI infrastructure.

• Create secure execution environments for code generated by agents.

• Design identity, authentication, and trust boundaries for agents.

• Construct model routing and orchestration across various model types and environments.

• Implement rate limiting, quotas, and resource management for workflows involving agents.

• Establish state management, memory, and filesystem abstractions for agents.

• Transform emerging ML research concepts into production-ready infrastructure.

• Develop core platform capabilities for execution, storage, and state management.

• Prototype and assess new technologies and assist in determining which ones transition to production.

• Collaborate with research teams to influence infrastructure for future agent systems.

⛳️ Requirements

• Proven experience in building production ML infrastructure with a solid foundation in systems.

• Practical experience with agentic systems, multi-agent workflows, or frameworks for agent development.

• Knowledge of model routing and frameworks for LLM providers across diverse model types and environments.

• Experience with scalable, fault-tolerant distributed systems and Kubernetes.

• History of swiftly advancing prototypes and making sound decisions regarding production readiness.

• Background in on-prem, private cloud, and public cloud environments.

• Familiarity with storage systems, embedded databases, or abstractions for filesystems.

• Experience with code execution sandboxes such as gVisor, Firecracker, Kata, or WASM runtimes.

• Interest in emerging ML infrastructure, edge inference, or browser-native models.

• Contributions to open-source projects related to LLM or agent infrastructure.

• Experience with identity management, workload authentication, or capability-based security systems.

• Must possess authorization to work in the country of current residence.

🏝️ Benefits

• A weekly lunch stipend of $75/£75 or its equivalent in your local currency.

• Comprehensive health and dental benefits, including a dedicated budget for mental health.

• RRSP matching, 401K, and Pension Scheme.

• 100% top-up for Parental Leave for up to 6 months, applicable to either parent.

• Annual enrichment benefits covering arts & culture, fitness/wellness, quality time, and workspace improvement credits.

• Education and learning stipend for conferences, courses, and coaching opportunities.

• Six weeks of paid vacation (30 working days).

• Budget allocated for travel to other offices for remote employees.

• Annual company offsite event.

• Daily lunch program, snacks, and regular community and social events for employees based in the office.

• Co-working benefits for employees residing far from an office.

• $500 stipend for home office setup.