B

Baseten

Runs AI models for production software

Product Manager - Grid

Technical Product ManagementPosted on Nov 11
Full-timeHybrid

About the Job

Requirements

  • Experience building and commercializing AI/ML products or developer platforms, with demonstrated adoption or business impact.
  • A technical background in software engineering, ML engineering, research, or equivalent hands-on experience.
  • Experience working with researchers or ML engineers on model behavior, evaluation, or learned systems in production.
  • Strong understanding of AI model quality, latency, cost, and the tradeoffs involved in optimizing across them.
  • Developer product instincts and appreciation for both simple APIs and enterprise-level controls.
  • Hands-on experience using coding agents and a strong point of view on where automation helps developers and where they need control.
  • Comfort building emerging products where the technical approach and customer expectations are still evolving.

Responsibilities

  • Own the product roadmap for Grid, from early developer adoption to production deployments and enterprise expansion.
  • Work with researchers and engineers to improve intelligent model selection, routing policies, fallbacks, and controls.
  • Build evaluation frameworks that measure real-world outcomes, including task quality, completion time, latency, and total cost.
  • Shape the developer experience for onboarding, configuration, observability, and routing decisions.
  • Help customers understand why a model was selected and give them confidence and control over how routing behaves.
  • Work through technical challenges involving conversation history, tool compatibility, prompt caching, retries, and routing overhead.
  • Partner with go-to-market teams and customers to turn early pilots into sustained adoption and revenue growth.

Desired Qualifications

  • Experience with large language model gateways, model routing, AI agents, coding harnesses, or multi-model platforms.

About the Company

Baseten

Runs AI models for production software

Baseten runs AI models for software companies that need fast, reliable responses inside their products, from text generation to speech and image processing. Its Inference Stack combines optimized model runtimes with infrastructure that deploys, serves, and monitors custom or open models in production. Teams package models with its open source Truss tool, while Model APIs let developers test ready-to-use models and Training runs jobs that adapt models to their own data. Customers pay for computing time or tokens processed, with negotiated plans for larger deployments and support needs. Baseten was founded in 2019 and is headquartered in San Francisco.

Company size
201-500
Company stage
Series F
Total funding
$2.1B
Headquarters
San Francisco, CA
Founded
2019

Recently Posted Jobs

Explore more opportunities at Baseten

See more jobs