Senior Director, Technical Product Management – AI Quality & Evaluation

This is a fully remote position, open to applicants in California, +1 more state.

📋 Description

• Develop the next generation of Agentforce within the entrepreneurial incubation team at Salesforce.

• Influence product strategy for AI quality and evaluation.

• Define how AI progress will be assessed, including quality definitions, evaluation requirements, coverage priorities, and release criteria.

• Establish product strategy and roadmap that align customer needs with technical opportunities and measurable business results.

• Make investment trade-offs among customer quality enhancements, evaluation capabilities, and product features.

• Lead customer inquiries and experiments addressing incorrect agent responses and unsuccessful tool-driven workflows.

• Specify expected behaviors and collaborate with researchers and engineers to test modifications and validate customer impact.

• Create a systematic approach that links customer feedback, evaluation evidence, experiments, releases, and learning.

• Collaborate with researchers, applied scientists, and engineers to design credible evaluations.

• Oversee the delivery of capabilities that assist customers in understanding and enhancing AI performance.

• Mentor product partners, junior designers, and technical program managers.

• Bring validated competitive insights into strategy and communicate differentiation, limitations, and investment decisions.

• Independently manage quality issues from failure analysis through experimentation and customer validation.

• Deliver focused features in collaboration with engineering and enhance release and investment decisions through evidence and product judgment.

⛳️ Requirements

• Proven track record of creating AI/ML products and achieving measurable customer outcomes, demonstrating increasing ownership, scope, and impact.

• Extensive hands-on experience in building AI agents and evaluation capabilities alongside AI researchers, applied scientists, or AI engineers.

• One to two years of significant generative AI experience can be adequate if supported by strong AI/ML fundamentals and proven impact.

• Strong applied AI/ML judgment regarding model behavior, prompting, retrieval, agent/tool workflows, and trade-offs among model, data, system, and product enhancements.

• Current hands-on capability to analyze data and traces, prototype with coding agents, and reason about experiments, overfitting, training/test splits, edge cases, and uncertainty.

• Ability to define quality for a non-deterministic system and to challenge technical conclusions.

• Experience in establishing shared standards and resolving cross-team conflicts while maintaining accountability and delivery momentum.

• Evidence of coaching and mentoring peers without direct reporting authority.

• Capacity to operate independently in a fast-paced environment.

• Strong communication skills with customers, technical teams, and senior leadership.

• Preferred: familiarity with evaluation platforms, agent systems, AI observability, retrieval, or enterprise AI products.

• Preferred: experience in an AI-native startup or entrepreneurial setting.

• Preferred: hands-on prototyping experience with coding agents and customer-facing performance or outcome engagements.

• Preferred: experience leading initiatives across research, engineering, product, and customer-facing organizations.

🏝️ Benefits

• Time off programs

• Medical insurance

• Dental insurance

• Vision insurance

• Mental health support

• Paid parental leave

• Life insurance

• Disability insurance

• 401(k)

• Employee stock purchasing program

• Certain roles may qualify for incentive compensation and equity

• Reasonable accommodations available during the application or recruitment process