B

Baseten

Runs AI models for production software

Technical Program Manager - Forward Deployed Engineering

Program ManagementConfirmed live in the last 24 hours
Full-timeHybrid

About the Job

Requirements

  • At least 5 years as a technical program manager, or as an engineer who transitioned to technical program management, on infrastructure, cloud, or customer-facing technical programs.
  • Technical familiarity with machine-learning infrastructure systems, Kubernetes, GPUs, and distributed systems sufficient to follow incident channels and design documents.
  • Experience running programs across many teams simultaneously and keeping them moving without formal authority.
  • Ability to structure escalations and close the loop.
  • Ability to write clearly and concisely for engineers and executives.
  • High ownership and a preference for fixing processes rather than working around them.

Responsibilities

  • Own the operating cadence for priority accounts, including daily hot-account check-ins, weekly leadership reviews, and the account list with Sales leadership, with the goal of preventing surprise executive escalations.
  • Establish clear ownership, cadence, and service-level agreements for connections between Forward Deployed Engineering, solutions architecture, Sales, Product, inference and infrastructure engineering, capacity, and on-call teams.
  • Manage transitions between solutions architects and Forward Deployed Engineering, including exit criteria and runbooks.
  • Track and reduce non-P0 escalations to engineering teams on a weekly basis.
  • Ensure customer patterns and gaps inform the product roadmap.
  • Coordinate cross-team programs for large customers, including dedicated-capacity rollouts, cluster migrations, capacity reservations, and large customer launches.
  • Track engineering time spent on incidents owned by other teams, manual routing and configuration changes, and after-hours pages; work with engineering leads to remove major sources of obstacles so Forward Deployed Engineers retain 30% of their time for platform work.
  • Build and report a metrics scorecard covering account health, response times, toil, load per engineer, and team health to leadership.
  • Drive new-hire enablement and certification, account load balancing, and runbook coverage programs.
  • Partner with Recruiting on hiring operations as the team grows.
  • Maintain visibility into cross-team dependencies and risks, surface them early, drive mitigation, and keep leadership informed with clear updates.
  • Translate between technical teams and senior leadership, run program reviews, and write concise status updates to support decisions.

Desired Qualifications

  • Experience with large language model inference.
  • Experience working on an artificial intelligence or machine-learning infrastructure stack.
  • Background in solutions engineering, site reliability engineering, or forward-deployed teams.

About the Company

Baseten

Runs AI models for production software

Baseten runs AI models for software companies that need fast, reliable responses inside their products, from text generation to speech and image processing. Its Inference Stack combines optimized model runtimes with infrastructure that deploys, serves, and monitors custom or open models in production. Teams package models with its open source Truss tool, while Model APIs let developers test ready-to-use models and Training runs jobs that adapt models to their own data. Customers pay for computing time or tokens processed, with negotiated plans for larger deployments and support needs. Baseten was founded in 2019 and is headquartered in San Francisco.

Company size
201-500
Company stage
Series F
Total funding
$2.1B
Headquarters
San Francisco, CA
Founded
2019

Recently Posted Jobs

Explore more opportunities at Baseten

See more jobs