S

Salesforce

Builds cloud software for customer relationships

Senior Director - Technical Product Management, AI Quality & Evaluation

Technical Product ManagementConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • A record of building AI/ML products and delivering measurable customer outcomes, with increasing ownership, scope, and impact.
  • Deep hands-on experience building AI agents and evaluation capabilities in close partnership with AI researchers, applied scientists, or AI engineers; one to two years of substantive generative AI experience can be sufficient when supported by strong AI/ML fundamentals and demonstrated impact.
  • Strong applied AI/ML judgment across model behavior, prompting, retrieval, agent/tool workflows, and the tradeoffs among model, data, system, and product improvements.
  • Current hands-on ability to inspect data and traces, prototype with coding agents, and reason about experiments, overfitting, training/test splits, edge cases, and uncertainty; ability to define quality for a non-deterministic system and challenge conclusions with technical partners.
  • Ability to frame underlying customer problems, test assumptions, and change direction when evidence warrants it, while distinguishing when lessons from a previous product apply.
  • Experience establishing shared standards and resolving cross-team disagreements while preserving clear accountability and delivery momentum.
  • Evidence of coaching and mentoring colleagues without relying on reporting authority, and ability to deliver independently in a fast-moving environment.
  • Clear communication with customers, technical teams, and senior leaders, including an honest account of what is known, uncertain, or still unproven.

Responsibilities

  • Set a coherent product strategy and roadmap for AI quality and evaluation, connecting customer needs, technical opportunities, and measurable business outcomes.
  • Establish shared quality definitions, evaluation requirements, coverage priorities, and release criteria with research, engineering, and product partners.
  • Make explicit investment tradeoffs across customer quality improvements, evaluation capabilities, and product features; align teams on priorities and decision ownership.
  • Lead customer investigations and experiments, such as investigating why an agent gives an incorrect answer or fails a tool-driven workflow, defining expected behavior, and partnering with researchers and engineers to test a change and validate customer impact.
  • Build an operating approach that connects customer feedback, evaluation evidence, experiments, releases, and learning across teams.
  • Partner with researchers, applied scientists, and engineers to design credible evaluations; apply AI/ML fundamentals such as training/test separation, overfitting, representative coverage, and independent validation to assess non-deterministic model behavior and grader reliability.
  • Lead delivery of capabilities that help customers understand and improve AI performance, such as prototyping an experience that turns a failed agent interaction into an evaluation case, clarifies the quality gap, and helps customers verify whether a proposed change works.
  • Coach product partners, junior designers, and technical program managers in problem framing, experimentation, and delivery; raise decision quality through mentorship and practical example.
  • Bring verified competitive insight into strategy and communicate differentiation, limitations, and investment choices clearly to customers and senior stakeholders.

Desired Qualifications

  • Experience with evaluation platforms, agent systems, AI observability, retrieval, or enterprise AI products.
  • Experience building in an AI-native startup or entrepreneurial environment, taking a new product from early customer learning to adoption, and applying lessons from successful and unsuccessful experiments.
  • Hands-on prototyping with coding agents and delivery of customer-facing performance or outcome experiences.
  • Experience leading initiatives requiring agreement across research, engineering, product, and customer-facing organizations.

About the Company

Salesforce

Builds cloud software for customer relationships

Salesforce sells cloud software that helps businesses manage sales leads, customer service, marketing, and online commerce from shared customer records. Its flagship Sales Cloud tracks accounts and deals, while Service Cloud organizes support cases and Agentforce builds AI assistants that act on company data. Teams access these tools through a browser and connect outside apps and data sources, with Slack for work messages and Tableau for visual analysis. Salesforce earns most of its revenue from software subscriptions and support, with professional services for implementation and training. Marc Benioff co-founded Salesforce in 1999, and its headquarters are in San Francisco, California.

Company size
10,001+
Company stage
IPO
Headquarters
San Francisco, CA
Founded
1999

Recently Posted Jobs

Explore more opportunities at Salesforce

See more jobs