L

Lambda

Cloud-based GPU services for AI training

Senior Software Engineer - Fleet Engineering

DevOps & InfrastructureConfirmed live in the last 24 hours
Full-time$230k - $395k /yr

About the Job

Requirements

  • Have 5 or more years of engineering experience.
  • Be fluent in Python, Go, or a similar programming language, and be comfortable with application programming interfaces, distributed systems, and automation pipelines.
  • Work confidently in Linux environments and debug across the operating system, hardware, and networking layers.
  • Have owned production systems with real service-level agreements.
  • Be able to lead technical design on medium-to-large features, take an ambiguous problem, write the design document, drive alignment across teams, and deliver the work.
  • Experience in AI or machine learning infrastructure, or other hyperscale compute environments, is preferred.
  • Hands-on experience with bare-metal provisioning and lifecycle management, including technologies such as PXE, Redfish, IPMI, BMC, DHCP, and DNS, is preferred.
  • Familiarity with datacenter physical infrastructure, including racks, switches, InfiniBand fabric, and power domains, is preferred.
  • Experience diagnosing issues involving drivers, firmware, and hardware compatibility across GPU servers is preferred.
  • Experience with DPUs or programmable network accelerators is preferred.
  • Experience with network source-of-truth systems such as NetBox, or similar systems, or DCIM tooling, is preferred.
  • Experience building Linux distributions or managing operating system customization and imaging is preferred.
  • Familiarity with Ansible or similar configuration management tooling is preferred.
  • Exposure to Kubernetes and container orchestration concepts is preferred.
  • Experience incorporating AI-assisted development tools into engineering workflows, including code generation, debugging, test development, and documentation, is preferred.

Responsibilities

  • Design, implement, and improve software for fleet lifecycle management, machine configuration, and cluster state at scale.
  • Build and enhance automation that takes clusters from logical design and racking through operating system provisioning, configuration, validation, and customer hand-off.
  • Enable bring-up, validation, and production readiness for new server, accelerator, and network platforms, as well as new datacenter sites.
  • Refine bare-metal provisioning, firmware and DPU updates, imaging, and system health monitoring across the fleet.
  • Build systems that reconcile intended against actual configuration, detect drift before it causes deployment failures, and maintain production service-level agreements.
  • Investigate failures across BIOS, BMC, firmware, DPUs, networking, storage, and boot flows.
  • Work closely with datacenter and deployment operations, networking, architecture, security, and product engineering teams to build scalable, maintainable solutions.

Desired Qualifications

  • Experience in AI or machine learning infrastructure, or other hyperscale compute environments.
  • Hands-on experience with bare-metal provisioning and lifecycle management, including technologies such as PXE, Redfish, IPMI, BMC, DHCP, and DNS.
  • Familiarity with datacenter physical infrastructure, including racks, switches, InfiniBand fabric, and power domains.
  • Experience diagnosing issues involving drivers, firmware, and hardware compatibility across GPU servers.
  • Experience with DPUs or programmable network accelerators.
  • Experience with network source-of-truth systems such as NetBox, or similar systems, or DCIM tooling.
  • Experience building Linux distributions or managing operating system customization and imaging.
  • Familiarity with Ansible or similar configuration management tooling.
  • Exposure to Kubernetes and container orchestration concepts.
  • Experience incorporating AI-assisted development tools into engineering workflows, including code generation, debugging, test development, and documentation.

About the Company

Lambda

Cloud-based GPU services for AI training

Lambda Labs provides cloud-based GPU services for AI training and inference via its AI Developer Cloud, powered by NVIDIA GH200 Grace Hopper hardware to efficiently train large language models and generative AI. Customers access on-demand or reserved GPUs and are billed by the hour (for example, NVIDIA H100 at about $1.99/hour); it also offers Lambda Echelon, where clients own infrastructure but pay a monthly hosting and support fee, and Lambda Stack, a software suite that helps ML teams install and upgrade tools like PyTorch, TensorFlow, CUDA, cuDNN, and NVIDIA drivers. The company differentiates itself through competitive pricing, available high-end hardware, and an integrated ML software stack that streamlines workflows. Its goal is to enable scalable, affordable AI development and deployment by providing flexible GPU access, reliable hosting, and easy software deployment for teams working with large models.

Company size
501-1,000
Company stage
Late Stage VC
Total funding
$9.1B
Headquarters
San Jose, CA
Founded
2012

Recently Posted Jobs

Explore more opportunities at Lambda

See more jobs