Senior Software Engineer – Dev Platform

This is a fully remote position, open to applicants in Brazil, +6 more countries.

📋 Description

• Develop and enhance the AI Gateway through the integration of models and providers, implementing routing policies, budgets, rate limits, and usage and cost reporting.

• Create APIs, SDKs, and self-service tools for engineers throughout Kraken.

• Assist teams in transitioning LLM workloads onto the gateway with minimal disruption.

• Collaborate with the Security team to implement access control, key management, and audit logging.

• Equip the gateway for monitoring latency, errors, token usage, and cost visibility.

• Take ownership of features from design to production.

• Maintain service reliability in partnership with SRE.

• Provide documentation and debugging support for internal users.

• Integrate user feedback into the development roadmap.

• Participate in code reviews, design documentation, and engineering practices across the Dev Platform.

⛳️ Requirements

• Extensive experience as a backend or platform software engineer focused on building and operating APIs and distributed services in a production environment.

• Proficient in a backend programming language such as Rust, Python, or TypeScript.

• Committed to writing well-tested, maintainable code.

• Familiar with LLM APIs, including aspects like authentication, streaming responses, token accounting, rate limits, and provider failure scenarios.

• Experienced with observability, CI/CD, and container technologies.

• Comfortable working with Kubernetes and a major cloud service provider.

• Capable of designing clean, well-documented APIs for internal stakeholders.

• Strong written and verbal communication skills.

• Demonstrated ownership of projects from conception to production.

• Preferred: experience with API gateways, proxies, or traffic management.

• Preferred: experience in building LLM-powered systems, including aspects like routing, caching, evaluation, or cost controls.

• Preferred: familiarity with OAuth, OIDC, and RBAC.

• Preferred: contributions to open-source infrastructure or developer-platform initiatives.

🏝️ Benefits

• Kraken product dogfooding requirement after joining.

• Equal opportunity employer.

• Consistent application of job-related skills or work-style assessments across candidates.

• Consideration of qualified applicants with criminal histories in accordance with the San Francisco Fair Chance Ordinance.