Software Engineer – Backend-Focused

This is a fully remote position, open to applicants in United States, +1 more country.

📋 Description

• Engage in software projects for client interactions and gradually enhance internal platform capabilities.

• Develop and sustain backend services for the LLM gateway, which includes routing, rate limiting, key management, and observability in relation to the inference fleet.

• Play a role in creating sandboxing and isolation infrastructure to ensure the safety of executing agent-generated code.

• Provide support for Kubernetes-based platform services, encompassing operators and autoscaling logic related to the inference platform.

• Write high-performance backend code using Go, Rust, or async Python (FastAPI/Starlette), while collaborating with Envoy and gRPC.

• Implement service instrumentation with OpenTelemetry to uphold observability concerning behavior, latency, and cost as the platform scales.

• Collaborate with teams across gateway, sandbox, and inference platforms, adapting to shifting priorities.

• Take ownership of the technical framework for model serving and evaluation at scale, including GPU scheduling, autoscaling, and serving infrastructure for vLLM/SGLang across both cloud and customer-managed clusters.

⛳️ Requirements

• Over 4 years of experience in backend engineering fundamentals: distributed systems, API design, and practical experience with Go, Rust, or async Python.

• Familiarity with LLM-specific backend challenges (such as rate limiting, caching, and token accounting) is advantageous but not mandatory from day one.

• Experience with Kubernetes and containerization.

• An interest in sandboxing or security is a plus.

• Ability to work across various platform concerns rather than focusing on a single specialty.

• Willingness to develop deeper specialization in gateway, sandbox, or inference infrastructure over time.

• High emotional intelligence coupled with a learning mindset.

• Strong collaborative abilities.

• Enjoy contributing to others' success in a fun and positive environment.

• Comfortable making decisions amid uncertainty and adjusting course as necessary.

• Experience in both startup and enterprise settings is a plus.

• Previous work in energy, real estate, utilities, climate, or related sectors is a bonus.

• Applicants must currently be authorized to work in the United States on a full-time basis.

• Must be willing to travel to the Seattle area for the final interview and participate in company summits twice a year.

🏝️ Benefits

• Competitive early-stage startup compensation based on skills, experience, and location.

• Eligibility for bonuses.

• Health insurance with substantial coverage for dependents.

• Flexible paid time off.

• Equity opportunities.

• Fully remote culture with a group of teammates based in Seattle.

• Access to training and learning opportunities.

• Join a rapidly growing, profitable, mission-driven company with industry-leading clients addressing the significant opportunities of AI transformation in critical sectors.