C

Cohere

Builds language models and workplace AI tools

Senior/Staff Software Engineer - Back-End, Inference

Backend EngineeringConfirmed live in the last 24 hours
Full-timeNo salary listed

About the Job

Requirements

  • Strong backend engineering fundamentals in distributed systems, databases, networking, operating systems, and security.
  • Strong programming fundamentals and experience building production systems in Go, Python, Java, C++, Rust, or a similar language; ability to write clean, maintainable, well-tested code and make tradeoffs among simplicity, performance, and correctness.
  • Experience designing and operating production systems where correctness, availability, security, and performance mattered at significant scale.
  • Ability to take ambiguous, high-impact technical problems, define architecture, and drive them through to reliable production systems.
  • Strong systems-design instincts and understanding of concurrency, consistency, caching, queues, rate limiting, backpressure, failure domains, idempotency, and graceful degradation.
  • Understanding of security boundaries, authentication, authorization, identity, cryptography, secrets, tenant isolation, and related security risks.
  • Ability to reason across backend services, APIs, databases, distributed systems, and cloud infrastructure.
  • Ability to dive into unfamiliar codebases and debug complex problems across service or system boundaries.
  • Attention to production engineering details, including instrumentation, capacity planning, migrations, backwards compatibility, incident response, and safe rollouts.
  • Ability to challenge existing architecture and evolve foundational components as system needs change.
  • Track record of taking technically difficult projects from an unclear starting point to systems relied on by engineers and customers.

Responsibilities

  • Evolve and scale the backend systems that power Model Vault, including authentication and authorization, deployment management, billing, metering, and customer lifecycle.
  • Lead major architectural initiatives across identity, payments, usage systems, platform scalability, and other core product foundations.
  • Build highly reliable control-plane services for provisioning, configuring, scaling, and operating model deployments across clouds and hardware platforms.
  • Design APIs and distributed systems with strong guarantees around correctness, consistency, isolation, failure recovery, idempotency, and observability.
  • Build security and privacy into platform architecture, including tenant isolation, least-privilege access, auditability, secrets management, encryption, and confidential computing boundaries.
  • Solve complex problems spanning backend systems, cloud infrastructure, security, and AI inference where conventional SaaS patterns are insufficient.
  • Drive projects end-to-end, from architecture and threat modeling through implementation, rollout, production operations, and iteration based on real customer workloads.

About the Company

Cohere

Builds language models and workplace AI tools

Cohere develops language models and AI software for businesses that need to search documents, generate text and automate work. Its customers include large organizations and developers building AI features into their own applications, with tools that connect company information to employee workflows. The North platform brings assistants and task automation into a shared workspace, while its models handle text generation and retrieval through software interfaces. Cohere earns revenue from paid model usage, dedicated deployment capacity and enterprise software agreements tailored to customer needs. The company was founded in 2019 and has its headquarters in Toronto, Ontario.

Company size
501-1,000
Company stage
Series E
Total funding
$2.1B
Headquarters
Toronto, Canada
Founded
2019

Recently Posted Jobs

Explore more opportunities at Cohere

See more jobs