T

Together AI

Runs cloud infrastructure for open AI models

Product Manager - AI Infrastructure

Technical Product ManagementUpdated on Nov 3
Full-timeSan Francisco, CA, USAIn-person

About the Job

Requirements

  • Deep empathy for customers operating in high-ambiguity, fast-evolving markets, including AI-native startups and model labs.
  • Strong, hands-on data and analytics skills with a hypothesis-driven approach, including designing experiments, reading data, and driving data collection to answer questions.
  • A technical foundation from an AI or infrastructure background, hands-on software development, or strong working knowledge of cloud and infrastructure.
  • A track record of collaborating across organizations and product lines.
  • Familiarity with the AI stack, especially at the infrastructure layer, is a strong plus.
  • Experience with a cloud platform such as AWS, Azure, or GCP; experience helping build such products is especially valued.
  • Working knowledge of the Nvidia or AMD GPU stack, including InfiniBand, NCCL, or GPU operator, or experience with AI training or inference workloads.

Responsibilities

  • Own day-to-day product and feature work across Together's AI infrastructure products—GPU Clusters, Managed Storage, and observability—with an early focus on observability and storage.
  • Find and drive problems to resolution with minimal guidance, including issues that are not yet on anyone's radar.
  • Run structured, hypothesis-driven experiments, read data, and drive the data collection and instrumentation needed to answer open questions.
  • Partner across engineering, product, and partner teams to ship improvements and unblock work.
  • Translate a deep understanding of customers in fast-moving, high-ambiguity markets into product decisions.
  • Manage multiple priorities and workstreams across a broad infrastructure surface.
  • Grow into end-to-end ownership of a complete product area, either observability or storage.

Desired Qualifications

  • Familiarity with the AI stack, especially at the infrastructure layer.
  • Cloud platform experience with AWS, Azure, GCP, or similar, particularly experience helping build cloud products.
  • Working knowledge of the Nvidia or AMD GPU stack, including InfiniBand, NCCL, or GPU operator, or experience with AI training or inference workloads.

About the Company

Together AI

Runs cloud infrastructure for open AI models

Together AI runs cloud infrastructure for developers and businesses that train, customize, and deploy AI models, with a focus on open models that customers control. Its platform combines model hosting with tools for adapting models to tasks such as coding assistants, customer support, and image generation. Developers call models through an API, reserve dedicated capacity for steady workloads, or rent GPU clusters for training, while the company charges for model usage and computing resources. Teams also fine-tune models on their own data and deploy the results through the same platform without building a separate serving system. Together AI was founded in 2022 and is based in San Francisco.

Company size
201-500
Company stage
Series C
Total funding
$1.3B
Headquarters
San Francisco, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at Together AI

See more jobs