N

Nebius

Runs GPU clouds for AI training and deployment

Senior Site Reliability Engineer - Token Factory, Inference Platform

Site Reliability EngineeringConfirmed live in the last 24 hours
Full-timeNo salary listed

About the Job

Requirements

  • Deep fluency with Kubernetes, Prometheus, Grafana, Terraform, and infrastructure-as-code.
  • Comfortable scripting in Python or Bash.
  • Understanding of alert design and service-level objectives for high-throughput application programming interfaces.
  • Production experience with distributed back-end systems and their failure modes.

Responsibilities

  • Own the reliability, performance, and observability of the inference stack.
  • Design and refine telemetry pipelines for metrics, logs, and traces.
  • Tune Kubernetes autoscalers to improve GPU efficiency.
  • Create Terraform modules that build resilience into new clusters.
  • Harden request-routing and retry logic to make transient failures unnoticeable to users.
  • Use automation and runbooks to detect, isolate, and remediate incidents in minutes.
  • Drive a post-mortem culture that prevents incident recurrence.
  • Scale the platform while meeting cost and reliability targets.
  • Collaborate with software engineers to make reliability a feature for users.

Desired Qualifications

  • Experience with GPU-heavy workloads, such as vLLM, Triton, Ray, or another accelerator stack.
  • Background in MLOps or model-hosting platforms.
  • Interest in building self-healing systems and debugging performance from kernel to application layer.

About the Company

Nebius

Runs GPU clouds for AI training and deployment

Nebius runs an AI cloud for developers, researchers, and enterprises that train models and put them into production. Its AI Cloud combines GPU computing, storage, networking, and managed services, while Token Factory runs models through an API so teams do not manage the underlying servers. Customers rent computing and storage at usage rates or reserve capacity, choosing resources that fit short experiments or sustained production workloads. Beyond the cloud, the group owns Avride, which develops autonomous vehicles and delivery robots, and TripleTen, which teaches technical skills for people changing careers. The publicly listed group is headquartered in Amsterdam, Netherlands.

Company size
1,001-5,000
Company stage
IPO
Headquarters
Amsterdam, Netherlands
Founded
1997

Recently Posted Jobs

Explore more opportunities at Nebius

See more jobs