Senior Product Manager, Agent Optimization

This is a fully remote position, open to applicants in California.

📋 Description

• Lead the product strategy and development roadmaps for portfolio initiatives.

• Establish priorities, quality standards, and product outcomes in collaboration with research and engineering teams.

• Collaborate with agent builders, observability and evaluation tool vendors, and partners to secure early access engagements.

• Ensure successful joint research and integrations, transforming market feedback into research directives and enhanced product capabilities.

• Convert research insights and methodologies into practical products and features.

• Define the developer experience and product interfaces for open-source tools.

• Enhance reliability, usability, documentation, benchmark coverage, and interoperability across various tools.

• Build adoption strategies in collaboration with Product Marketing, Solution Architects, and Go-To-Market teams.

• Identify suitable partners and workloads, guide pilot projects, and develop repeatable adoption playbooks.

• Create messaging and narratives focused on agent optimization and continuous improvement cycles.

• Define and assess evidence of success across research initiatives, products, partnerships, open-source adoption, and publications.

• Take ownership of outcomes and determine what should be scaled, modified, discontinued, or incubated next.

⛳️ Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or a related discipline, or equivalent experience.

• Over 12 years of product management or closely related experience in developing technically advanced, zero-to-one AI or developer products.

• Proven track record of transforming ambiguous research or emerging technical capabilities into widely adopted products through partnerships, integrations, or open source initiatives.

• Technical proficiency in agent architectures, observability, evaluation design, and automated experimentation methods.

• Capability to independently engage mature customers and ecosystem partners, recruit design collaborators, identify production constraints, and guide GTM teams in emerging zero-to-one projects.

• Strong rapport with Engineering and Research teams; adept at asking insightful questions, converting uncertainty into actionable decisions, and providing support without dictating implementation.

• Evidence-based product approach rooted in reproducible benchmarks, clear success criteria, and sound judgment regarding supported claims.

• Exceptional written and verbal communication skills, along with the ability to prioritize at the portfolio level and align senior technical and business leaders around a coherent product narrative.

• Experience in building agent infrastructure, AI observability, evaluation, optimization, or developer tooling within a leading AI lab or high-caliber startup.

• Direct experience in designing benchmarks, evaluation systems, experimentation methodologies, or contributing to research publications for AI products.

• Proven history of engagement with open-source communities, SDKs, platform integrations, or developer ecosystems.

• Practical experience in building production agents and enhancing them based on both quantitative and qualitative metrics.

🏝️ Benefits

• Equity.

• Comprehensive benefits package.