
Senior AI Product Manager
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in Colombia.
• Take ownership of the complete product delivery process for intricate AI and agentic AI projects, covering everything from discovery and hypothesis formation to phased rollout and production readiness.
• Develop and maintain AI product roadmaps aligned with measurable business outcomes for the enterprise.
• Lead user research initiatives, conduct stakeholder interviews, and perform assumption testing and discovery activities.
• Design and execute experiments, including proof of concepts (POCs), pilot deployments, and scenario-based testing for multi-step agentic workflows, edge cases, and failure recovery.
• Define agent behaviors, which encompass system prompts, tool schemas, context management, summarization, and working memory patterns.
• Manage the backlog and execute sprints, prioritizing tasks and refining agent behavior and requirements in collaboration with engineering.
• Develop and oversee evaluation frameworks that assess task completion, reasoning quality, tool selection, failure recovery, and safety.
• Establish success metrics at the agent level and define business key performance indicators (KPIs).
• Set human-in-the-loop boundaries and guardrails for AI systems.
• Utilize AI tools like Claude, Claude Code, Cursor, and GitHub Copilot to enhance daily operations.
• Facilitate stakeholder working sessions, prioritization discussions, and risk management conversations with senior client stakeholders.
• Articulate complex AI trade-offs, agent behavior, and product decisions to both technical and non-technical executive audiences.
• Build trusted relationships with client stakeholders throughout project engagements.
• Drive prioritization decisions by weighing business value, technical feasibility, cost, latency, and delivery timelines.
• Frame requests in terms of user and business outcomes while managing expectations related to AI hype cycles realistically.
• Mentor junior AI product managers on evaluations, agent design, and best practices in AI product delivery.
• A minimum of 5 years of product management experience with direct involvement in launching AI features or products.
• Proficient in reading code (Python, JavaScript, or TypeScript).
• Ability to assess architectural decisions and make informed product trade-offs considering technical constraints.
• Strong grasp of AI concepts, including LLMs, RAG, fine-tuning, prompt and context engineering, agentic systems, human-in-the-loop controls, guardrails, and evaluations.
• Demonstrated experience in prototyping AI and agentic solutions using contemporary AI tools such as Claude, Claude Code, Cursor, and GitHub Copilot.
• Experience in conducting evaluations for AI systems and iterating based on outcomes.
• Background in defining agent behavior, including system prompts, tool schemas, and human-in-the-loop frameworks.
• Extensive experience working with AWS AI services in a product context, such as Bedrock, Lambda, SageMaker, or Kendra.
• Excellent communication skills with clients, able to explain AI capabilities and limitations to non-technical executive audiences.
• Comfortable navigating ambiguous and fast-paced environments.
• Previous experience in a consulting or agency setting is a plus.
• Familiarity with LangChain, LangGraph, or AWS Strands is advantageous.
• A software engineering background in Python, JavaScript, or TypeScript is a plus.
• Practical experience with open-source LLMs is beneficial.
• Exposure to multi-modal AI is advantageous.
• Understanding of AI governance or responsible AI frameworks is beneficial.
• Depth of knowledge in sectors such as Consumer Products and Retail, Education, Energy, Financial Services, Healthcare, or Manufacturing is advantageous.
• Employment may be contingent upon successfully passing a background check.
• Comprehensive benefits package that includes paid time off.
• Medical insurance coverage.
• Dental insurance options.
• Vision insurance benefits.
• 401(k) plan available for eligible employees.
• A background check may be required as a condition of employment.
Capital One
Emerald Zebra Talent Solutions
Adobe
Aiphoria
Get handpicked remote jobs straight to your inbox weekly.