L

Lambda

Cloud-based GPU services for AI training

Senior Software Engineer - Managed Kubernetes

Backend EngineeringConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • Have 6 or more years of software engineering experience and a track record of owning significant technical scope within a team, such as driving a project from design through production or acting as a de facto technical lead on a workstream.
  • Have a deep understanding of Kubernetes internals, including controllers, schedulers, operators, custom resource definitions, container storage interface, container networking interface, and Kubernetes extension patterns.
  • Understand distributed systems fundamentals, including fault tolerance, graceful degradation, and failure handling in large-scale environments.
  • Have experience operating the control plane and low-level components of large-scale Kubernetes clusters.
  • Have experience with observability at scale, including Prometheus, Grafana, distributed tracing, and building actionable alerting systems.
  • Have strong programming skills in Go and Python and be able to collaborate on shared codebases.
  • Have solid knowledge of Linux systems, networking, containers, and cloud infrastructure.
  • Own and deliver core product and platform components.

Responsibilities

  • Design, build, and maintain scalable control-plane services, operators, and custom Kubernetes controllers; develop automation in Go and Python for end-to-end cluster lifecycle management, including provisioning, upgrades, patching, and deletion.
  • Build GPU-aware orchestration systems within the platform architecture to support GPU scheduling and resource allocation.
  • Partner with the Network team on networking solutions for AI workloads, including CNI integration using Cilium and Multus, high-performance fabrics such as InfiniBand and RoCE, RDMA, and GPUDirect.
  • Build resilient systems that handle failure gracefully through timeouts, retries, backoff, and degraded-mode operation across large-scale distributed environments.
  • Develop inference platform services, including model-serving infrastructure, autoscaling based on inference load, and multi-model deployment patterns.
  • Build internal tools and command-line interfaces that allow ML/AI teams to deploy and monitor their own inference services.
  • Support and debug production issues through an on-call rotation.

Desired Qualifications

  • Have experience building and operating managed Kubernetes services such as GKE, EKS, or AKS, or working on Kubernetes control-plane components.
  • Have hands-on experience with NVIDIA's GPU and networking ecosystem, including GPU Operator, device plugins, DCGM, MIG, Network Operator, and NCCL tuning, or similar tools.
  • Be familiar with high-performance computing and traditional job schedulers such as Slurm, as well as Kubernetes-native batch schedulers such as KAI, Volcano, and Kueue.
  • Be familiar with GPU, InfiniBand, RDMA, or high-performance computing on Kubernetes.
  • Have exposure to storage architecture for AI/ML workloads.
  • Have contributed to CNCF projects or Kubernetes SIGs.

About the Company

Lambda

Cloud-based GPU services for AI training

Lambda Labs provides cloud-based GPU services for AI training and inference via its AI Developer Cloud, powered by NVIDIA GH200 Grace Hopper hardware to efficiently train large language models and generative AI. Customers access on-demand or reserved GPUs and are billed by the hour (for example, NVIDIA H100 at about $1.99/hour); it also offers Lambda Echelon, where clients own infrastructure but pay a monthly hosting and support fee, and Lambda Stack, a software suite that helps ML teams install and upgrade tools like PyTorch, TensorFlow, CUDA, cuDNN, and NVIDIA drivers. The company differentiates itself through competitive pricing, available high-end hardware, and an integrated ML software stack that streamlines workflows. Its goal is to enable scalable, affordable AI development and deployment by providing flexible GPU access, reliable hosting, and easy software deployment for teams working with large models.

Company size
501-1,000
Company stage
Late Stage VC
Total funding
$9.1B
Headquarters
San Jose, CA
Founded
2012

Recently Posted Jobs

Explore more opportunities at Lambda

See more jobs