Senior Software Engineer – AI Platform Team

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and manage the LLM and agent infrastructure utilized throughout Coinbase.

• Take charge of the architecture and deployment of the LLM Gateway, AI Hub, and agent runtime.

• Create and implement the Knowledge Base infrastructure, incorporating vector and markdown storage solutions.

• Drive AI FinOps capabilities focusing on spend attribution, governance, and cost optimization.

• Collaborate with teams from engineering, security, legal, finance, product, frontier labs, and cloud providers.

• Construct evaluation and observability tools, including LLM-as-judge harnesses, tracing mechanisms, and feedback loops.

• Influence the applied AI strategy by developing production agents and utilizing fine-tuning or traditional machine learning when suitable.

• Oversee multi-quarter technical projects from design through to production operation.

⛳️ Requirements

• More than 5 years of software engineering experience in building ML/AI infrastructure, LLM systems, or large-scale distributed platform services.

• Proven ability to lead multi-quarter projects from start to finish, covering technical design to production operation.

• In-depth knowledge of LLM orchestration patterns, agent frameworks, vector databases, and model serving infrastructure across multiple providers.

• Demonstrated history of collaborating with security, legal, and product teams to deliver governed, production-ready AI systems.

• Proficiency in Python and at least one systems language: Go, Rust, or C++.

• Hands-on experience in developing APIs, microservices, and runtime environments.

• Commitment to the responsible use of generative AI, ensuring human oversight and measurable improvements in workflow, cost, and quality.

🏝️ Benefits

• Equity and bonus eligibility.

• Medical insurance.

• Dental insurance.

• Vision insurance.

• 401(k).

• Quarterly in-person working sessions known as “surges.”