M

Modal

Cloud-based on-demand code execution platform

Member of Technical Staff - Machines

Platform EngineeringConfirmed live in the last 24 hours
Full-time$250k - $300k /yrIn-person

About the Job

Requirements

  • Have at least 5 years of experience writing high-quality production code.
  • Have experience operating fleets of physical hardware, such as bare-metal provisioning, BMC/IPMI, PXE or network boot, and firmware, or building control planes that manage them.
  • Have strong cloud skills.
  • Have strong knowledge of low-level operating system foundations, including the Linux kernel, drivers, networking, file systems, and containers.
  • Be effective at debugging across layers, including BGP flapping, Linux RPS, vBIOS bugs, and Python control-plane services.
  • Be willing to participate in the on-call rotation and respond to production incidents.

Responsibilities

  • Design, build, and maintain the high-performance systems that make up the serverless platform, including the machines layer and its provisioning, imaging, monitoring, and repair control plane.
  • Automate remediation of unhealthy machines, including power cycling, reimaging, and GPU recovery, to maximize uptime and minimize operator toil.
  • Automate integration of new CPU, GPU, and storage servers into the fleet while managing hardware and network heterogeneity.
  • Monitor network health and reliability across datacenters, and standardize bare-metal network configuration.
  • Automate hardware acceptance testing and benchmarking for CPU, disk, GPU, interconnect, and network.
  • Build the custom network bootloader, machine image pipeline, and kernel and firmware management across the fleet.
  • Automate integration of new capacity from hardware providers by auditing and benchmarking hosts and clusters, maintaining machine images, configuring GPUs, RDMA, networking, and storage, and bringing machines into production.
  • Build automation to keep the fleet healthy without human intervention, including detecting faulty GPUs, thermal issues, and disks.
  • Debug issues between hardware and the software running on it, including kernel panics, broadcast storms during boot, and adapting the container runtime to new architectures and platforms.

Desired Qualifications

  • Have production experience with GPUs and the NVIDIA software stack, including drivers, health monitoring, XIDs, RDMA, or NVLink.
  • Have prior experience with Go.

About the Company

Modal

Cloud-based on-demand code execution platform

Modal provides on-demand cloud compute for developers, data engineers, and machine learning practitioners, letting users run code in the cloud without managing underlying infrastructure. It works by letting users define their environment in Python code and launch hundreds of custom containers in the cloud, with near-instant startup thanks to a high-performance file system, and it supports on-demand GPUs and serverless web endpoints while charging for compute resources used. It differentiates itself through a Python-centric workflow, fast container startup, and an integrated set of tools for monitoring, live logs, and distributed queues to handle scalable workloads. Its goal is to simplify cloud-based execution of code and data workloads, offering a scalable, cost-aware platform for modern software development.

Company size
201-500
Company stage
Series D
Total funding
$1.2B
Headquarters
New York City, New York
Founded
2021

Recently Posted Jobs

Explore more opportunities at Modal

See more jobs