Staff Product Manager, AI Foundations

This is a fully remote position, open to applicants in United States.

📋 Description

• Take ownership of the strategy and roadmap for Vanta’s fundamental AI capabilities: the agent harness and AI quality and evaluation framework.

• Examine agent traces to gain insights into customer usage and pinpoint high-impact enhancements.

• Develop golden datasets, automated evaluators in alignment with expert judgment, and self-service evaluation tools.

• Expand the agent harness while balancing cost, latency, reliability, and safety considerations.

• Establish quality benchmarks for evaluations, launch readiness, and observability, and promote their adoption.

• Collaborate with EPD teams and AI pillar teams to transform validated patterns into shared capabilities.

• Contribute to defining and cultivating Vanta’s product team culture as the organization evolves.

⛳️ Requirements

• Over 8 years of product management experience, encompassing platform, infrastructure, or technically complex products.

• Practical experience in building with LLMs and AI agents.

• Knowledge of evaluations, observability, and quality indicators for systematic improvement in AI products.

• Strong user empathy with an ability to comprehend customer challenges.

• Experience managing foundational products with goals for adoption, feedback loops, and user-centered prioritization.

• Credibility with senior engineers and the capacity to engage in highly technical design discussions.

• Regular use of coding agents and a deep curiosity about models and agent tools.

• Systems thinking that encompasses evaluation, observability, and infrastructure decisions.

• Ability to excel in ambiguity within a rapidly evolving AI landscape.

• Clear and persuasive written and verbal communication skills.

• Willingness to responsibly utilize AI to enhance efficiency and impact.

🏝️ Benefits

• Industry-competitive equity.

• Comprehensive medical, dental, and vision coverage.

• 100% of employee-only benefit premiums covered for most medical plans.

• 16 weeks of paid Parental Leave for all new parents.

• Health & wellness stipend.

• Remote workspace, internet, and cellphone stipend.

• Commuter benefits for team members commuting to the SF and NYC offices.

• Family planning benefits.

• Matching 401(k) contribution with immediate vesting.

• Flexible PTO policy.

• 80 hours of Sick Time.

• 11 company-paid holidays.

• Virtual team-building activities, lunch and learns, and other company-wide events.