Principal Product Manager, AI Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Take ownership of the vision, strategy, and roadmap for Angi’s shared AI Platform.

• Oversee the model-agnostic AI Gateway, which includes routing, cost attribution, rate limiting, provider failover, spending caps, and stop switches.

• Establish the evaluation engine, including pass/fail quality gates, prompt versioning, rollback procedures, and per-agent accuracy scoring.

• Define the trust-and-autonomy ladder that governs agent independence, evidence, approvals, and rollback logic.

• Manage the production self-hosted LLM, open-weight model, and traditional machine learning serving infrastructure.

• Identify and instrument metrics related to platform health, cost, ROI, adoption, and business impact.

• Collaborate with product engineering, architecture, and data science teams to enhance platform adoption.

• Handle a multifaceted platform backlog across parallel tracks while managing capacity constraints.

• Make and convey decisions regarding sequencing and trade-offs.

• Translate infrastructure investments into clear business outcomes for stakeholders.

⛳️ Requirements

• Over 8 years of experience in Product Management.

• A minimum of 4 years focusing on infrastructure, platforms, ML/AI systems, or other technical products for internal engineering or data science clients.

• Proven experience in scaling technical platforms from inception to maturity for demanding internal customers.

• Technical fluency in model serving and inference, API gateways/proxies, evaluation and testing frameworks, and cloud/Kubernetes infrastructure.

• Ability to engage with engineers and data scientists on architectural trade-offs.

• Demonstrated capability to utilize telemetry and cost data, including model performance, evaluation results, adoption analytics, and spending data, to identify bottlenecks and shape product strategy.

• Preferred knowledge of LLM gateways/proxies such as LiteLLM.

• Preferred experience with evaluation and observability tools such as Langfuse.

• Preferred familiarity with model serving frameworks like KServe, SageMaker, Bedrock, and Ray.

• Experience in prompt management and versioning, LLM fine-tuning, or self-hosted/open-weight model serving in production.

• Understanding of agent governance concepts, including guardrails, PII controls, prompt-injection protection, and autonomy/trust frameworks.

• Experience managing a platform amidst competing tracks and stakeholders.

• Exceptional leadership abilities with a track record of influencing cross-functional teams without direct authority.

🏝️ Benefits

• Salary range of $190,000 – $280,000.

• Competitive year-end performance bonus.

• Equity package.

• Comprehensive medical, dental, and vision coverage.

• Flexible vacation policy.

• Pet discount plans.

• Retirement plan with company match (401K).

• Opportunity to collaborate with sharp, motivated teammates on unique challenges.