P

Prophet

Growth and transformation consulting for disruption

Senior Product Manager - AI Foundry Team

Technical Product ManagementConfirmed live in the last 24 hours
Full-timeNew York, NY, USA$165k - $220k

About the Job

Requirements

  • Seven or more years of product management experience, including at least two years in a technical product environment such as AI/ML, platform products, developer tools, enterprise software, or data products.
  • Ability to read and write code, navigate APIs, data schemas, and developer environments, and participate effectively in engineering discussions; Python is preferred.
  • Hands-on experience with LLM-based products, agents, or AI workflow tools, including prompt engineering, model evaluation, retrieval-augmented generation systems, tool calling, or structured outputs.
  • Understanding of AI product evaluation, including defining quality for probabilistic systems, creating test cases, identifying hallucination or reasoning failures, and setting release criteria.
  • Experience with enterprise data and integration patterns, including APIs, databases, permissions, authentication, and workflow integrations.
  • Experience with production monitoring, incident triage, quality assurance, release management, and continuous improvement based on telemetry and user feedback.
  • Ability to lead cross-functional teams through ambiguity, remove roadblocks, and hold people accountable without micromanaging.
  • Ability to develop clear specifications and present confidently to technical and business audiences, tailoring messages to the audience.
  • Experience building or managing internal AI tools, productivity platforms, or workflow automation products.
  • Familiarity with one or more of Python, TypeScript, React, FastAPI, LangChain, LangGraph, LlamaIndex, OpenAI or Anthropic APIs, vector databases, Jira, GitHub, Vercel, Supabase, or similar tools and technologies.

Responsibilities

  • Own the AI Foundry product backlog and release cadence from planning through launch.
  • Assess technical feasibility and architecture tradeoffs to support informed prioritization decisions.
  • Define acceptance criteria grounded in user value, system constraints, and release quality.
  • Lead day-to-day execution of the Foundry product team by unblocking work, setting priorities, and driving momentum through ambiguity.
  • Build prototypes, review code, and run experiments as part of hands-on technical involvement.
  • Partner with engineering on specifications, sprint execution, quality assurance, release sign-off, and architecture decisions.
  • Define evaluation methods for MAIA capabilities before and after launch, including testing protocols for agent accuracy, hallucination risk, tool use, latency, and reliability.
  • Build benchmark sets, red-team scenarios, regression tests, and release gates.
  • Monitor production performance, including failure rates, cost, and user drop-off, and translate telemetry and incident data into product fixes and roadmap priorities.
  • Design and run experiments to test new agent capabilities, benchmark model performance, and make go/no-go recommendations.
  • Evaluate retrieval-augmented generation, knowledge graphs, agent orchestration, API integration, and model selection against complexity, cost, latency, accuracy, and maintainability; present recommendations with explicit tradeoffs and a focus on shippable solutions.
  • Gather high-value use cases from consulting teams and translate them into agent specifications, workflow diagrams, tool requirements, and acceptance tests.
  • Manage the agent lifecycle from prototype through production, including prompt design, testing, monitoring, and deprecation.
  • Support client-facing applications by coordinating feature requirements and contributing to implementation.
  • Work with IT, security, legal, and business stakeholders to ensure responsible handling of enterprise data.
  • Define requirements for permissions, access control, auditability, and user-facing guardrails, and ensure new capabilities are designed with trust and governance in mind.
  • Drive adoption across consulting teams by understanding workflows, shaping onboarding, and creating feedback loops.
  • Define and report metrics for adoption, task completion, time saved, output quality, cost-to-serve, and business impact; use insights to prioritize improvements and communicate progress to Center of Excellence leadership.
  • Prepare technical demos, architecture documentation, release notes, and status updates, and interface with stakeholders across design, engineering, consulting, marketing, IT/security, and external partners.
  • Champion the end-user experience and uphold user interface and user experience quality by articulating what works, what does not, and what should change.

Desired Qualifications

  • Consulting or consulting-adjacent experience is a strong plus.
  • Experience with retrieval-augmented generation, vector databases, embeddings, knowledge graphs, agent orchestration, or LLM observability tools.
  • Experience with secure enterprise environments, including single sign-on, role-based access control, audit logs, data privacy, or vendor review.
  • Experience in consulting, professional services, or financial services.
  • A track record of turning prototypes into production products with clear success metrics and adoption plans.

About the Company

Prophet

Growth and transformation consulting for disruption

Prophet is a growth and transformation consulting firm that helps organizations manage disruption and unlock sustainable, purpose-driven growth over time. It partners with clients through an initial consultation to tailor services, then delivers actionable recommendations that combine analytical and creative thinking. The engagement typically includes benchmarking digital maturity, defining a path for digital transformation, and redefining brand strategy in the digital space. Unlike some firms, Prophet emphasizes a human-centric approach with a diverse team that brings multiple perspectives to produce practical solutions and closely collaborates with clients to guide their next growth move. The core goal is to enable enduring growth and transformation for clients, anchored in clarity of purpose and a clear roadmap for change.

Company size
501-1,000
Company stage
Late Stage VC
Total funding
$95.8M
Headquarters
San Francisco, CA
Founded
1992

Recently Posted Jobs

Explore more opportunities at Prophet

See more jobs