Senior Product Manager, Switchyard

atNVIDIARemoteUS flagCaliforniaFull-timeProduct ManagerSenior$168k – $327.8k/year

Posted 3 hours ago

This is a fully remote position, open to applicants in California.

📋 Description

• Lead the product strategy and roadmap for Switchyard, establishing priorities, quality standards, and product outcomes in collaboration with Engineering.

• Collaborate with agent harness builders, inference gateways, model serving systems, and partners to ensure successful integrations.

• Define the developer experience and product interfaces for adaptive inference.

• Work alongside Research to transform advancements in cost and quality prediction, constrained optimization, and budget allocation into tangible products and features.

• Collaborate with Engineering to enhance reliability, usability, documentation, SDK coverage, and production customization.

• Foster adoption initiatives with Product Marketing, Solution Architects, and GTM teams.

• Identify suitable workloads, oversee partner pilots, and create replicable deployment playbooks.

• Develop messaging and narratives for model routing and adaptive inference in partnership with Product Marketing.

• Define and evaluate success metrics and take ownership of outcomes.

• Coordinate with adjacent teams to create collaborative product outcomes.


⛳️ Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or a related discipline, or equivalent experience.

• Over 8 years of product management or closely related experience in building technical products for developers, infrastructure teams, or AI practitioners.

• Proven track record in scaling developer or infrastructure products through effective partnership and integration strategies.

• Technical expertise in LLM inference, model routing, agent runtimes, and developer APIs.

• Strong analytical skills to assess quality, cost, and latency trade-offs.

• Capability to independently engage with mature customers and partners, guiding GTM teams through complex technical adoption processes.

• Established relationships with Engineering and Research teams.

• Evidence-based product approach supported by benchmarks, evaluations, and clear success criteria.

• Exceptional written and verbal communication skills along with sound judgment.

• Ability to align senior technical and business leaders across different organizational boundaries.

• Technical understanding to examine APIs, traces, and benchmark results directly.

• Experience with LLM routers, AI gateways, model serving, distributed inference, or dynamically allocated test-time compute.

• Experience transitioning research from prototype to a reliable, widely adopted developer product.

• Proven history of involvement with open-source communities, SDKs, platform integrations, or developer ecosystems.

• Practical familiarity with agent building, evaluation systems, and inference optimization.


🏝️ Benefits

• Equity

• Comprehensive benefits package

• Competitive salaries

People also viewed

ASAAS3 hours ago

AI Product Manager

BR flagBrazil OnlyFull-timeProduct Manager
ApplyView job
RUX Software3 hours ago

Product Owner

US flagUnited States, +1 more countryFull-timeProduct Manager
ApplyView job
Clutch3 hours ago

Staff Product Manager, AI Agents

US flagUnited States OnlyFull-timeProduct Manager
ApplyView job
NVIDIA3 hours ago

Senior Product Manager, Agent Optimization

US flagCalifornia OnlyFull-timeProduct Manager$208k – $379.5k/year
ApplyView job
Quest Analytics, LLC3 hours ago

Senior Product Manager – Regulatory

US flagAlabama, +37 more statesFull-timeProduct Manager
ApplyView job
RUX Software4 hours ago

Product Owner

CA flagCanada, +1 more countryFull-timeProduct Manager
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers