Technical Product Manager – Inference

This is a fully remote position, open to applicants in Europe.

📋 Description

• Take charge of the strategy, roadmap, and execution of NEXUS inference offerings.

• Analyze the competitive landscape and transform customer requirements along with performance and cost trade-offs into well-defined offerings.

• Collaborate with Engineering to outline scope, dependencies, capacity requirements, and delivery timelines.

• Prioritize, launch, evaluate, and refine inference products.

• Manage adoption, utilization, and expenses for inference products while enhancing product economics.

• Conduct customer discovery sessions with enterprise clients and their ML, platform, and IT teams.

• Convert requirements regarding latency, throughput, compliance, reliability, and cost into actionable roadmap decisions.

• Work closely with inference and other engineering teams on capacity planning, product priorities, and timelines.

• Oversee model administration functionalities, which include deployment versioning, controlled upgrades, rollback procedures, monitoring, and alerts.

• Establish customer consumption models for both managed services and customer-controlled environments.

• Collaborate with product marketing and go-to-market teams on offerings and pricing strategies.

• Manage administrative and governance capabilities, which encompass the customer portal, user and API key management, access controls, auditability, usage visibility, and data-handling measures.

⛳️ Requirements

• 7+ years of product management experience in model inference, infrastructure, developer platforms, or API products, demonstrating a history of leading technical products from initial development to launch and measurable adoption or revenue growth.

• In-depth knowledge of inference, model serving, and cloud infrastructure, with the capability to assess architecture and API choices and translate latency, throughput, capacity, reliability, and cost trade-offs into product decisions.

• Strong commercial acumen and understanding of infrastructure economics, with experience leveraging customer needs, usage patterns, and cost drivers to influence product offerings and priorities alongside engineering and go-to-market teams.

• Proven experience collaborating directly with enterprise ML, platform, or IT teams to grasp production requirements, differentiate reusable features from customer-specific requests, and make challenging prioritization decisions.

• Experience in converting vague product goals into actionable delivery plans with designated owners, milestones, and dependencies, driving cross-functional delivery to launch while monitoring progress and resolving obstacles.

• Proficiency in defining product success metrics and establishing the necessary analytics and tracking to measure adoption, usage, performance, reliability, and cost, using these insights to identify risks and prioritize enhancements.

• Direct experience managing inference or model-serving products is highly preferred.

• Experience in shaping pricing and packaging for technical products.

• Prior experience in software, infrastructure, or ML engineering before transitioning to product management.

• Familiarity with deploying products in customer-controlled environments, such as customer VPCs, and addressing integration, security, administration, and support needs for production adoption.

• Experience in developing enterprise security, identity, and access management product capabilities or integrations with data and ML platforms.

🏝️ Benefits

• Competitive compensation package that includes salary and equity.

• Comprehensive health insurance coverage for you and your dependents.

• Paid parental leave available for all new parents, inclusive of adoptive and surrogate journeys.

• Relocation assistance for employees moving to join the team at one of our office locations.

• A culture built on trust and humility that values diverse thoughts, ownership, and initiative, while respecting personal boundaries and working styles.