Technical Product Manager, Artificial Intelligence (AI) Systems

This is a fully remote position, open to applicants in California.

📋 Description

• Conduct research and establish comprehensive requirements for Artificial Intelligence (AI) systems, encompassing capabilities, behaviors, and user impacts.

• Convert model capabilities, data limitations, and evaluation findings into straightforward product and system choices.

• Navigate trade-offs involving quality, latency, cost, reliability, and user experience (UX).

• Collaborate closely with Machine Learning (ML), backend, and mobile engineers on system architecture, assessment, and iterative development.

• Define and refine evaluation frameworks that encompass offline metrics, online experiments, and human feedback.

• Propel execution with well-defined specifications, sound judgment, and disciplined prioritization.

• Ensure systems are delivered quickly, securely, and reliably, with robust feedback mechanisms in place.

• Take ownership of product quality from start to finish, focusing on accuracy, predictability, and user confidence.

• Align AI functionalities with user requirements and organizational priorities.

• Develop clear roadmaps and priorities, allowing for rapid iterations driven by user feedback.

• Maintain team alignment and concentration on AI product objectives.

⛳️ Requirements

• Practical experience with Artificial Intelligence (AI)-driven products, particularly LLM-based systems.

• Proven experience in the field of Artificial Intelligence (AI) is essential.

• Familiarity with model evaluation, prompt or pipeline iterations, and feedback mechanisms.

• Strong understanding of model limitations, hallucinations, biases, and drift.

• Solid foundation in computer science principles, including algorithms, data structures, and system design.

• Comprehensive knowledge of Machine Learning (ML) basics and the behavior of modern Artificial Intelligence (AI) systems in production settings.

• Comfortable reading, reviewing, and discussing technical design documents.

• Significant experience managing complex, technical products from inception to completion.

• Demonstrated ability to collaborate closely with senior engineers and ML teams.

• Strong judgment and decision-making skills in ambiguous and fast-paced environments.

• Ability to reconcile ambition with technical and operational realities.

• Must be prepared to undertake a 60-minute coding assessment.

• Experience in launching consumer products heavily based on Artificial Intelligence (AI) is a benefit.

• A background as an engineer or in a highly technical product management role is advantageous.

• Experience in defining evaluation metrics for Machine Learning (ML) systems is a plus.

• Strong intuition regarding Artificial Intelligence (AI) User Experience (UX) patterns and failure management is an asset.

• Previous experience in zero-to-one product settings is a valuable addition.

🏝️ Benefits

• Medical insurance

• Dental insurance

• Vision insurance

• Savings Plan Options

• Paid Time Off (PTO)

• Remote work / work from home