B

Baseten

Runs AI models for production software

Global Capacity Manager

Platform EngineeringConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USAHybrid

About the Job

Requirements

  • A bachelor's, master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or a related field.
  • At least 5 years of professional work experience in a high-growth environment; experience at a hyperscaler such as GCP, AWS, or Azure, or at a specialized GPU provider, is preferred.
  • Deep expertise in Kubernetes, including hands-on experience with taints, cordons, node draining, and custom operators.
  • Demonstrated production-level experience with Go or Python.
  • Strong financial literacy and the ability to model complex trade-offs between capacity reliability and cost.
  • A collaborative mindset.

Responsibilities

  • Lead specialized GPU pods, managing the full lifecycle of asset acquisition, air traffic control, and maintenance.
  • Execute complex workload migrations and sticky deployment drains, ensuring deployment scheduling rules meet strict regional and compliance requirements.
  • Design and implement the next version of the capacity management system to handle a tenfold increase in GPU volume.
  • Build return-on-investment models for GPU spending to ensure the company scales profitably.
  • Partner with SRE, infrastructure, and FDE teams to take discrete operational tasks off their plate and verify follow-through on infrastructure changes.
  • Lead capacity-crunch response by rapidly untainting and re-coordinating workloads during high-pressure outages.

Desired Qualifications

  • Experience at a hyperscaler such as GCP, AWS, or Azure, or at a specialized GPU provider.

About the Company

Baseten

Runs AI models for production software

Baseten runs AI models for software companies that need fast, reliable responses inside their products, from text generation to speech and image processing. Its Inference Stack combines optimized model runtimes with infrastructure that deploys, serves, and monitors custom or open models in production. Teams package models with its open source Truss tool, while Model APIs let developers test ready-to-use models and Training runs jobs that adapt models to their own data. Customers pay for computing time or tokens processed, with negotiated plans for larger deployments and support needs. Baseten was founded in 2019 and is headquartered in San Francisco.

Company size
201-500
Company stage
Series F
Total funding
$2.1B
Headquarters
San Francisco, CA
Founded
2019

Recently Posted Jobs

Explore more opportunities at Baseten

See more jobs