T

Together AI

Runs cloud infrastructure for open AI models

Senior Software Engineer - Together Cloud Platform

Backend EngineeringConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USA

About the Job

Requirements

  • At least 5 years of demonstrated experience building large-scale, fault-tolerant distributed systems and API microservices.
  • Experience designing, analyzing, and improving the efficiency, scalability, and stability of system resources.
  • Ability to write clear design documents and work effectively with technical and non-technical team members.
  • Demonstrated experience building and operating high-performance and/or globally distributed microservice architectures across one or more cloud providers, such as AWS, Azure, or GCP.
  • Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale.
  • Experience developing against and managing a relational database such as PostgreSQL.
  • Expert-level programming ability in one or more programming languages; Golang is preferred.
  • Proficiency in version control practices and integrating infrastructure as code with continuous integration and continuous delivery pipelines.
  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience.

Responsibilities

  • Identify, design, and develop foundational backend services that power Together’s cloud platform.
  • Analyze and improve the robustness and scalability of existing distributed systems, APIs, databases, and infrastructure.
  • Partner with product teams to understand functional requirements and deliver solutions that meet business needs.
  • Write clear, well-tested, and maintainable software and infrastructure as code for new and existing systems.
  • Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance.
  • Participate in an on-call rotation to address critical incidents when necessary.
  • Work on a distributed GPU scheduling system for the on-demand clusters product, Instant Clusters.
  • Build out a global management plane for data center compute, networking, and storage.
  • Design and build new customer-facing cloud platform services and enterprise AI cloud features.

Desired Qualifications

  • Experience with Kubernetes and containers is preferred.
  • Experience building and operating data infrastructure such as Kinesis, Airflow, or Kafka is a plus.

About the Company

Together AI

Runs cloud infrastructure for open AI models

Together AI runs cloud infrastructure for developers and businesses that train, customize, and deploy AI models, with a focus on open models that customers control. Its platform combines model hosting with tools for adapting models to tasks such as coding assistants, customer support, and image generation. Developers call models through an API, reserve dedicated capacity for steady workloads, or rent GPU clusters for training, while the company charges for model usage and computing resources. Teams also fine-tune models on their own data and deploy the results through the same platform without building a separate serving system. Together AI was founded in 2022 and is based in San Francisco.

Company size
201-500
Company stage
Series C
Total funding
$1.3B
Headquarters
San Francisco, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at Together AI

See more jobs