
Senior AI Product Manager
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in Colombia.
• Take charge of the complete product delivery process for intricate AI and agentic AI projects, starting from discovery and hypothesis formulation to phased implementation and production readiness.
• Create and uphold AI product roadmaps that align with measurable business outcomes within the enterprise.
• Facilitate user research, conduct stakeholder interviews, test assumptions, and drive discovery initiatives.
• Design and execute POCs, pilot launches, and scenario-based testing for multi-step agentic workflows, including edge cases and recovery from failures.
• Specify agent behavior, incorporating system prompts, tool schemas, context management, summarization, and working memory patterns.
• Manage and implement evaluation frameworks that assess task completion, reasoning quality, tool selection, failure recovery, and safety.
• Establish agent-level success metrics such as task completion rate, cost per task, escalation rate, and time to resolution, in conjunction with business KPIs.
• Define human-in-the-loop boundaries and guidelines for autonomous actions, escalations, and unpredictable outputs.
• Utilize AI-centric tools like Claude, Claude Code, Cursor, and GitHub Copilot to enhance product development.
• Lead working sessions with stakeholders, prioritization meetings, and risk discussions with senior client representatives.
• Articulate AI trade-offs, agent behavior, and product decisions to both technical and non-technical executive audiences.
• Develop trustworthy, consultative relationships with client stakeholders throughout the project lifecycle.
• Drive prioritization decisions that consider business value, technical feasibility, cost, latency, and delivery schedules.
• Frame requests around user and business outcomes while managing AI hype cycles with realistic expectations.
• Provide mentorship to junior AI product managers on evaluation processes, agent design, and AI product delivery methodologies.
• Over 5 years of product management experience with practical expertise in delivering AI features or products.
• Proficiency in reading Python, JavaScript, or TypeScript code.
• Capability to assess architectural decisions and make informed product trade-offs considering technical constraints.
• Extensive knowledge of LLMs, RAG, fine-tuning, prompt and context engineering, agentic systems, planning, tool usage, human-in-the-loop controls, guardrails, and evaluations.
• Demonstrated ability to prototype AI and agentic solutions utilizing contemporary AI tools such as Claude, Claude Code, Cursor, and GitHub Copilot.
• Experience in conducting evaluations for AI systems and iterating based on the outcomes.
• Background in defining agent behavior, including system prompts, tool schemas, and human-in-the-loop boundaries.
• Strong experience with AWS AI services such as Bedrock, Lambda, SageMaker, and Kendra within a product context.
• Excellent client communication skills, with the ability to effectively frame AI capabilities and limitations for non-technical executive audiences.
• Comfortable operating in environments that are ambiguous and fast-paced.
• Experience in consulting or agency settings, familiarity with agent orchestration frameworks like LangChain, LangGraph, or AWS Strands, or a background in software engineering is a plus.
• Competitive salary and performance-based bonuses.
• Opportunities for professional development and continued learning.
• Flexible work hours and remote working options.
• Access to cutting-edge AI tools and technologies.
• Collaborative and inclusive work environment.
CVS Health
Insurity
PrizePicks
Get handpicked remote jobs straight to your inbox weekly.