T

Together AI

Runs cloud infrastructure for open AI models

Senior Product Manager - Inference

Technical Product ManagementConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USAIn-person

About the Job

Requirements

  • Strong product judgment and the ability to take an ambiguous technical problem, identify what matters, make tradeoffs, and develop a clear point of view.
  • Meaningful experience building or owning APIs, developer tools, infrastructure, cloud platforms, data systems, AI products, or another technically deep product.
  • Strong technical depth and curiosity, with the ability to work credibly with engineers and researchers, reason about system behavior and constraints, and go deeper when the product problem requires it.
  • A hands-on operating style, including comfort testing APIs and SDKs, using developer tools, reading technical documentation or code when useful, and building lightweight prototypes or analyses to sharpen thinking.
  • Strong developer and customer empathy, including care for how a system feels to integrate with and operate in production.
  • A track record of making clear product decisions and shipping in fast-moving environments where the right answer is not always obvious.
  • Strong communication and cross-functional leadership, with the ability to earn trust across engineering, research, customers, and business teams.

Responsibilities

  • Shape the inference product strategy by defining how Together’s portfolio should serve customer needs across tenancy, capacity, performance, workload patterns, and modalities.
  • Own the developer experience around inference by improving APIs, SDKs, compatibility, and integrations across applications, coding agents, frameworks, and developer tools.
  • Understand how agentic, voice, multimodal, batch, and other workload patterns are changing customer needs, and translate those shifts into product direction.
  • Work with inference platform engineers and researchers to understand capabilities and constraints across performance, routing, caching, reliability, capacity, and model behavior, and translate them into customer-facing abstractions, guarantees, and controls.
  • Shape pricing and packaging alongside Finance and GTM, and use adoption, inference consumption, utilization, unit economics, and customer expansion to prioritize investment.
  • Talk with developers and enterprise teams, inspect usage patterns, test workflows, and use that context to decide what to build.
  • Partner with engineering, research, sales, partnerships, finance, and other teams to make tradeoffs, align on priorities, launch products, and iterate.

Desired Qualifications

  • Experience with LLM inference, model serving, distributed systems, GPU infrastructure, agents, or developer-facing AI products is helpful but not required.

About the Company

Together AI

Runs cloud infrastructure for open AI models

Together AI runs cloud infrastructure for developers and businesses that train, customize, and deploy AI models, with a focus on open models that customers control. Its platform combines model hosting with tools for adapting models to tasks such as coding assistants, customer support, and image generation. Developers call models through an API, reserve dedicated capacity for steady workloads, or rent GPU clusters for training, while the company charges for model usage and computing resources. Teams also fine-tune models on their own data and deploy the results through the same platform without building a separate serving system. Together AI was founded in 2022 and is based in San Francisco.

Company size
201-500
Company stage
Series C
Total funding
$1.3B
Headquarters
San Francisco, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at Together AI

See more jobs