T

Together AI

Runs cloud infrastructure for open AI models

Staff Platform Infrastructure Engineer

Platform EngineeringConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USAIn-person

About the Job

Requirements

  • At least 7 years of professional experience in platform engineering, service infrastructure, site reliability engineering, cloud infrastructure, or a related field.
  • Deep production experience with Kubernetes and AWS, including operating shared infrastructure for deployment, networking, identity, scaling, or service reliability. Examples include EKS, IAM, VPC, Route 53, CloudFront, and ECR.
  • Strong experience with Terraform and infrastructure delivery automation.
  • Working knowledge of service and edge networking, including DNS, TLS, content delivery networks, load balancing, and ingress and egress.
  • Proficiency in Go, Python, TypeScript, or another systems- or infrastructure-oriented programming language.
  • Experience building reusable infrastructure used by multiple engineering teams and helping those teams adopt it in production.
  • Ability to lead ambiguous, cross-functional infrastructure initiatives and a track record of driving adoption across teams the candidate does not manage.

Responsibilities

  • Set technical direction for service infrastructure across Kubernetes, AWS, content delivery networks and edge networking, and related operational patterns.
  • Design and build reusable infrastructure primitives, such as Helm charts and Terraform modules.
  • Build self-service platform capabilities, operational runbooks, and AI-assisted tooling that accelerate service development and operations.
  • Partner closely with service teams to modernize existing services and adopt stronger infrastructure patterns.
  • Work with Infrastructure, Networking, and Security teams to translate company-wide platform standards into practical service-level implementations.
  • Lead cross-company infrastructure initiatives such as Terraform CI/CD, Kubernetes networking, zero-trust service communication, policy-as-code, and cross-data-center and cross-provider networking.
  • Hire and grow the initial Platform Infrastructure team.
  • Ship a new golden-path service template, including scaffolding, Helm chart, CI/CD, and GitOps, and move the first set of services onto it.
  • Implement zero-trust policies on production clusters.
  • Collaborate with Developer Productivity and site reliability engineers on the migration to Kargo.

Desired Qualifications

  • Experience with GitHub Actions, GitOps workflows, and service scaffolding.
  • Experience with Argo CD, Argo Rollouts, or Kargo.
  • Experience designing or operating content delivery networks, web application firewalls, edge infrastructure, or Layer 4 networking.
  • Experience with service meshes, zero-trust networking, policy-as-code, multi-region or hybrid infrastructure, or supply-chain security.
  • Experience operating distributed streaming systems such as Kafka, Flink, or Spark Streaming as shared platform services for data teams.
  • Experience building or applying AI-assisted tooling to improve service development or operations.
  • Strong written technical communication.

About the Company

Together AI

Runs cloud infrastructure for open AI models

Together AI runs cloud infrastructure for developers and businesses that train, customize, and deploy AI models, with a focus on open models that customers control. Its platform combines model hosting with tools for adapting models to tasks such as coding assistants, customer support, and image generation. Developers call models through an API, reserve dedicated capacity for steady workloads, or rent GPU clusters for training, while the company charges for model usage and computing resources. Teams also fine-tune models on their own data and deploy the results through the same platform without building a separate serving system. Together AI was founded in 2022 and is based in San Francisco.

Company size
201-500
Company stage
Series C
Total funding
$1.3B
Headquarters
San Francisco, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at Together AI

See more jobs