L

Lambda

Cloud-based GPU services for AI training

Staff Software Engineer - Managed Kubernetes

Platform EngineeringConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • At least 10 years of experience in software engineering, platform engineering, or site reliability engineering, including at least 5 years focused on Kubernetes at scale.
  • Expert understanding of Kubernetes internals, including API machinery, controllers, schedulers, operators, custom resource definitions, container storage interface, container network interface, and Kubernetes extension patterns.
  • Holistic infrastructure expertise across compute, networking, storage, and security, with the ability to build full-stack solutions.
  • Strong software engineering skills in Go and Python, including writing production-quality code.
  • Deep experience with GPU orchestration in Kubernetes, including NVIDIA GPU Operator, device plugins, data center GPU manager, multi-instance GPU, time-slicing, and GPU-aware scheduling.
  • A proven track record of technical leadership, driving design decisions across teams, mentoring engineers, and influencing infrastructure direction beyond the immediate team.
  • Deep experience designing and operating managed services or multi-tenant platforms, including infrastructure for external customers.
  • Strong understanding of distributed systems principles, including consensus, fault tolerance, consistency models, and graceful degradation.
  • Experience with observability at scale, including Prometheus, Grafana, distributed tracing, and actionable alerting systems.
  • Solid knowledge of Linux systems and networking from Layer 2 through Layer 7, including high-performance networking concepts such as remote direct memory access, InfiniBand, and RoCE.
  • Experience with infrastructure as code and GitOps workflows.

Responsibilities

  • Drive the technical vision for Lambda’s bare-metal Managed Kubernetes platform, including control-plane scalability, multi-tenancy, cluster lifecycle management, and high availability.
  • Integrate and extend NVIDIA’s open-source ecosystem, including GPU Operator, Network Operator, data center GPU manager, NCCL, and projects such as AICR and Topograph for topology-aware scheduling and placement.
  • Design GPU-aware orchestration systems.
  • Lead development of services that power managed services.
  • Inform and help develop networking solutions for AI workloads, including container network interface integrations such as Cilium and Multus, high-performance fabrics such as InfiniBand and RoCE, remote direct memory access, and GPUDirect; work with the Network team to define and drive requirements.
  • Inform and help define storage architecture requirements for AI workloads, partnering with Storage teams on the needs of Managed Kubernetes, Slurm, and future services.
  • Build the foundation for Managed Slurm on Kubernetes so traditional high-performance computing workloads can run alongside Kubernetes workloads.
  • Design higher-level inference platform services, including model-serving infrastructure, autoscaling based on inference load, and multi-model deployment patterns.
  • Design self-healing systems and automation for incident response, root-cause analysis, and platform resilience.
  • Lead chaos engineering efforts to validate system behavior under failure conditions at scale.
  • Establish operational excellence for managed services through upgrade automation, security patching, and zero-downtime maintenance.
  • Serve as the technical bridge between Orchestration and Network, Storage, and Security teams, translating platform requirements into actionable specifications.
  • Drive infrastructure-wide decisions that enable successful managed services, applying end-to-end understanding beyond the Kubernetes layer.
  • Provide input on bare-metal provisioning, network topology, and storage systems so they meet the requirements of services built by the Orchestration organization.
  • Champion consistency and standardization across Lambda’s infrastructure stack.
  • Work directly with customers and internal teams to understand existing deployments and chart a path to the managed platform.
  • Set technical direction for Kubernetes services across the Orchestration team, influencing roadmap and prioritization.
  • Drive reviews and design sessions to ensure systems are scalable, maintainable, and aligned with customer needs.
  • Mentor and grow engineers, establishing best practices for Kubernetes development, distributed systems, and cloud-native engineering.
  • Collaborate cross-functionally with Network, Storage, Security, and Customer Success teams.
  • Engage with NVIDIA and the open-source community to stay current on GPU orchestration technologies and contribute back where appropriate.
  • Represent Lambda externally through technical blog posts, conference talks, and strategic customer engagements.
  • Shape the AIOps vision by designing intelligent systems for automated capacity planning, anomaly detection, and predictive maintenance of cloud infrastructure.

Desired Qualifications

  • Experience building and operating managed Kubernetes services such as GKE, EKS, or AKS, or working on Kubernetes control-plane components.
  • Hands-on experience with NVIDIA’s open-source ecosystem beyond GPU Operator, including Network Operator, NCCL tuning, Topograph, AICR, or similar emerging projects.
  • Familiarity with high-performance computing and traditional job schedulers such as Slurm, and Kubernetes-native batch schedulers such as KAI, Volcano, and Kueue.
  • Background in confidential computing.
  • Experience migrating customers or workloads from legacy or bespoke infrastructure to standardized platforms.
  • Contributions to Cloud Native Computing Foundation projects, Kubernetes Special Interest Groups, or NVIDIA open-source projects.
  • Familiarity with security and compliance in multi-tenant environments, including role-based access control, Pod Security Standards, network policies, and workload isolation.
  • Background in machine learning infrastructure, including training clusters, inference serving, or simulation.
  • Strongly preferred familiarity with NVIDIA Network Operator and GPUDirect.

About the Company

Lambda

Cloud-based GPU services for AI training

Lambda Labs provides cloud-based GPU services for AI training and inference via its AI Developer Cloud, powered by NVIDIA GH200 Grace Hopper hardware to efficiently train large language models and generative AI. Customers access on-demand or reserved GPUs and are billed by the hour (for example, NVIDIA H100 at about $1.99/hour); it also offers Lambda Echelon, where clients own infrastructure but pay a monthly hosting and support fee, and Lambda Stack, a software suite that helps ML teams install and upgrade tools like PyTorch, TensorFlow, CUDA, cuDNN, and NVIDIA drivers. The company differentiates itself through competitive pricing, available high-end hardware, and an integrated ML software stack that streamlines workflows. Its goal is to enable scalable, affordable AI development and deployment by providing flexible GPU access, reliable hosting, and easy software deployment for teams working with large models.

Company size
501-1,000
Company stage
Late Stage VC
Total funding
$9.1B
Headquarters
San Jose, CA
Founded
2012

Recently Posted Jobs

Explore more opportunities at Lambda

See more jobs