T

Together AI

Runs cloud infrastructure for open AI models

Senior Network Engineer

Network Engineering & AdministrationUpdated on Nov 13
Full-timeNo salary listedRemote

About the Job

Requirements

  • At least 8 years of professional experience designing, building, and supporting large-scale production data center, cloud, service-provider, or high-performance computing networks, excluding enterprise networks.
  • Hands-on experience deploying or operating RoCE and/or InfiniBand fabrics.
  • Deep understanding of TCP/IP and strong experience with BGP, OSPF, VXLAN, EVPN, ECMP, and QoS.
  • Experience designing and supporting multi-tenant network environments using VRFs, VLANs, overlays, and policy-based segmentation.
  • Hands-on experience deploying and troubleshooting network platforms from vendors such as Arista, Cisco, Juniper, and NVIDIA.
  • Strong troubleshooting skills using Wireshark, tcpdump, MTR, curl, nmap, and standard Linux networking utilities.
  • Ability to diagnose connectivity, latency, packet-loss, routing, and performance issues across network, host, and application layers.
  • Experience developing or maintaining network automation using Python, Ansible, or similar tools.
  • Experience working through a Git-based software development lifecycle, including branching, code review, validation, linting, testing, CI/CD, deployment, and rollback.
  • Working knowledge of Kubernetes networking, including pods, services, CNIs, and basic connectivity troubleshooting.
  • Foundational knowledge of RDMA networking and technologies such as RoCE or InfiniBand.
  • Experience with cloud networking in AWS, GCP, or Azure.
  • Strong Linux administration and troubleshooting skills.

Responsibilities

  • Design, deploy, operate, and maintain global, multi-vendor, multi-protocol networks supporting high-performance AI compute infrastructure.
  • Troubleshoot complex network and application-connectivity issues, identify root causes, and drive problems through resolution.
  • Analyze telemetry, packet captures, logs, and performance data to identify network degradation, congestion, packet loss, and capacity constraints.
  • Participate in architecture and design reviews to ensure solutions meet requirements for performance, availability, scalability, security, and operational supportability.
  • Develop and maintain automation, validation, and operational tooling that improves network reliability and reduces manual effort.
  • Evaluate network hardware, software, optics, and emerging technologies for use in production environments.
  • Establish standards and operational best practices for network design, deployment, monitoring, change management, and incident response.
  • Lead projects addressing complex technical challenges and contribute directly to the network engineering roadmap.
  • Partner with infrastructure, systems, security, and application teams to troubleshoot issues that cross traditional ownership boundaries.

Desired Qualifications

  • Experience supporting GPU clusters, HPC environments, distributed storage, or other high-bandwidth and latency-sensitive workloads.
  • Understanding of AI training and inference traffic patterns and the demands they place on network infrastructure.
  • Experience operating networks spanning thousands of devices, multiple data centers, and multiple geographic regions.
  • Familiarity with AI-assisted engineering tools and the ability to validate, test, and safely deploy AI-generated automation or code.

About the Company

Together AI

Runs cloud infrastructure for open AI models

Together AI runs cloud infrastructure for developers and businesses that train, customize, and deploy AI models, with a focus on open models that customers control. Its platform combines model hosting with tools for adapting models to tasks such as coding assistants, customer support, and image generation. Developers call models through an API, reserve dedicated capacity for steady workloads, or rent GPU clusters for training, while the company charges for model usage and computing resources. Teams also fine-tune models on their own data and deploy the results through the same platform without building a separate serving system. Together AI was founded in 2022 and is based in San Francisco.

Company size
201-500
Company stage
Series C
Total funding
$1.3B
Headquarters
San Francisco, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at Together AI

See more jobs