This is a fully remote position, open to applicants in Portugal.

📋 Description

• Take charge of the roadmap for Sword's Applied AI platform, spanning from strategic initiatives and innovative projects to ongoing platform maintenance.

• Operate at the convergence of AI and product management, focusing on agents, evaluations, harnesses, and observability.

• Manage trade-offs related to cost, latency, quality, the use of open-source models, and in-house development.

• Define initiatives in collaboration with Engineering, AI, and Product teams while balancing the need for reusability against differentiation.

• Work closely with Engineering, Product, Clinical, and Operations teams to ensure that the scope aligns with high-value member experiences.

• Uphold the quality standard post-release and address any model degradation occurring in production.

• Ensure safety in collaboration with the clinical team, focusing on the prevention, detection, and response to agent errors.

⛳️ Requirements

• Over 5 years of experience in product management, with recent hands-on responsibility for an AI-powered product.

• Strong technical expertise in AI, particularly in generative AI, along with an understanding of models, prompting, retrieval, and agent architectures.

• Experience delivering LLM-based features to real users, including aspects such as evaluation, annotation, observability, and failure-mode management.

• Capability to engage in AI or engineering discussions and link technical choices to member experiences.

• Proficiency in tracking the state of the art and fostering innovation through sound product and technical judgment.

• Excellent written and verbal communication skills.

• Skilled in utilizing coding agents for debugging, data analysis, production monitoring, small builds, tooling, research, and process automation.

• Ability to lead and develop a small product team.

• Proven AI proficiency at least at the Explorer (Level 1) level.