Senior Software Engineer – AI Platform Team

This is a fully remote position, open to applicants in California.

📋 Description

• Take ownership of the architecture and delivery of essential platform systems, which include the LLM Gateway (60+ models, authentication, PII redaction, fallbacks, cost optimization), AI Hub, and agent runtime utilizing microVM sandboxes and a governed MCP gateway.

• Spearhead the design and execution of Knowledge Base infrastructure that links data sources to auto-provisioned vector and markdown stores, making them accessible for querying by any agent.

• Lead the development of AI FinOps capabilities encompassing spend attribution, governance, and cost optimization across all AI workloads company-wide.

• Collaborate with teams across engineering, security, legal, finance, product, and external partners at frontier labs and major cloud providers to deliver high-impact platform capabilities.

• Create evaluation and observability tools, including LLM-as-judge harnesses, comprehensive tracing, and feedback loops, allowing subject matter experts to refine production agents.

• Influence applied AI strategy by integrating with teams to develop production agents, employing fine-tuning and traditional ML techniques where they demonstrate superior performance over prompting.

⛳️ Requirements

• Over 5 years of software engineering experience with a proven track record in building ML/AI infrastructure, LLM systems, or distributed platform services at scale.

• Proven capability to lead multi-quarter initiatives from beginning to end, encompassing technical design to production operation, with measurable impact across the platform.

• Extensive expertise in LLM orchestration patterns, agent frameworks, vector databases, and model serving infrastructure across various providers.

• Established history of cross-functional collaboration with security, legal, and product teams to deliver governed, production-grade AI systems.

• Proficient in Python and at least one systems programming language (Go, Rust, or C++), with hands-on experience in developing APIs, microservices, and runtime environments.

• Employs generative AI responsibly, ensuring human oversight to produce business-ready outputs that drive measurable enhancements in workflow efficiency, cost, and quality.

🏝️ Benefits

• Medical

• Dental

• Vision

• 401(k)