C

Cohere

Builds language models and workplace AI tools

Staff Software Engineer - Data Infrastructure

Platform EngineeringPosted on Nov 16
Full-timeNew York, NY, USANo salary listedIn-person

About the Job

Requirements

  • Strong storage fundamentals, including replication, consistency, caching, and data lifecycle management, with demonstrated architecture and design experience.
  • Strong coding ability in Python and Go, with the ability to lead implementations and mentor others in either language, and the willingness to contribute to the other.
  • Proven experience running stateful systems on Kubernetes, including Persistent Volumes, CSI drivers, and StatefulSets, with the capacity to design and execute operational strategies.
  • Hands-on experience with cloud object storage such as S3 and POSIX-style filesystems.

Responsibilities

  • Design, architect, and operate the distributed storage system that feeds model training and evaluation, driving the technical vision from concept through production.
  • Lead and own the deployment of this system across multiple Kubernetes clusters at petabyte scale, setting standards and best practices for the organization.
  • Collaborate with researchers and training-infrastructure teams to define how jobs read and write data, translating those patterns into throughput, latency, and durability requirements that shape the platform's roadmap.
  • Navigate the networking, input/output, and consistency challenges of moving large datasets and checkpoints across regions and backends, using GPU idle time and time-to-insight as key success metrics and driving solutions that improve them.

Desired Qualifications

  • Experience with parallel or high-performance computing filesystems such as Weka, VAST, or Lustre, and a track record of applying them at scale.
  • Familiarity with the data-loading and checkpointing patterns used in large-scale model training, with the ability to innovate on them.
  • An interest in how large models are trained and evaluated, including the trajectory and evaluation data those runs generate, and a desire to understand the workloads the platform serves, with the capacity to guide others in that understanding.

About the Company

Cohere

Builds language models and workplace AI tools

Cohere develops language models and AI software for businesses that need to search documents, generate text and automate work. Its customers include large organizations and developers building AI features into their own applications, with tools that connect company information to employee workflows. The North platform brings assistants and task automation into a shared workspace, while its models handle text generation and retrieval through software interfaces. Cohere earns revenue from paid model usage, dedicated deployment capacity and enterprise software agreements tailored to customer needs. The company was founded in 2019 and has its headquarters in Toronto, Ontario.

Company size
501-1,000
Company stage
Series E
Total funding
$2.1B
Headquarters
Toronto, Canada
Founded
2019

Recently Posted Jobs

Explore more opportunities at Cohere

See more jobs