Staff Software Engineer, AI

This is a fully remote position, open to applicants in United States, +1 more country.

📋 Description

• Take ownership of the AI foundational product teams, focusing on model selection and routing, the model proxy layer, context management, and tool design.

• Manage evaluation infrastructure and collaborate with customers and finance domain experts to establish high-quality outputs, encapsulated in reusable evaluations.

• Deliver agentic features from inception to completion, including prompt and context engineering, caching, parallel tool calls, and subagent patterns.

• Integrate observability into agent behavior to analyze performance, identify bottlenecks, and determine data-driven solutions.

• Monitor changes within agentic systems and apply proven practices to enhance engineering processes.

⛳️ Requirements

• Proven experience in shipping production LLM systems—such as evaluations, context management, and multi-model or multi-provider routing—with the ability to discuss challenges faced and solutions implemented.

• Skilled in creating proof of concepts, making quick decisions, and delivering initial versions. Evaluations are your benchmark for quality.

• Strong judgment regarding abstractions: you have clear design opinions while being pragmatic about incremental shipping.

• Familiarity with LLM APIs and agent frameworks, having successfully launched user-facing products.

• A desire to build production systems rather than engage in research.

• Evidence of adoption: teams outside your management have embraced the systems you developed due to their excellence.

• Solid foundational skills: you can trace requests from the UI to the data store and make sound technical decisions at every layer.

• High agency: you have a background as a founder, engineering lead, or startup builder, showcasing a builder's mindset and creativity in shipping solutions.

• Pragmatic approach: you opt for the simplest and most effective tools that deliver results.

• Commitment to craft: you prioritize code quality and write code that is both accurate and easy to understand.

• Excellent communication skills: you convey information clearly and persuasively to both technical and non-technical audiences.

• Experience in developing complex B2B products, ideally from the ground up.

🏝️ Benefits

• Equity offerings.

• Fully remote positions available in the US, Canada, and Latin America.

• Flexible working hours.

• Unlimited paid time off (PTO).

• Regular in-person retreats.

• Provision of a MacBook Pro or Lenovo.

• Health insurance for US and Canadian employees.

• Guideline 401(k) for US employees.