M

Modal

Cloud-based on-demand code execution platform

Member of Technical Staff - ML Performance

Systems Software EngineeringConfirmed live in the last 24 hours
Full-time$200k - $350k /yrIn-person

About the Job

Requirements

  • Have 5 or more years of experience writing high-quality, high-performance code.
  • Have experience with torch, high-level machine learning frameworks, and inference engines such as vLLM or TensorRT.
  • Be familiar with NVIDIA GPU architecture and CUDA.
  • Have experience with machine learning performance engineering.

Responsibilities

  • Contribute to open-source projects and Modal’s container runtime to improve language and diffusion models’ throughput and latency.

Desired Qualifications

  • Be familiar with low-level operating system foundations, including the Linux kernel, file systems, and containers.

About the Company

Modal

Cloud-based on-demand code execution platform

Modal provides on-demand cloud compute for developers, data engineers, and machine learning practitioners, letting users run code in the cloud without managing underlying infrastructure. It works by letting users define their environment in Python code and launch hundreds of custom containers in the cloud, with near-instant startup thanks to a high-performance file system, and it supports on-demand GPUs and serverless web endpoints while charging for compute resources used. It differentiates itself through a Python-centric workflow, fast container startup, and an integrated set of tools for monitoring, live logs, and distributed queues to handle scalable workloads. Its goal is to simplify cloud-based execution of code and data workloads, offering a scalable, cost-aware platform for modern software development.

Company size
201-500
Company stage
Series D
Total funding
$1.2B
Headquarters
New York City, New York
Founded
2021

Recently Posted Jobs

Explore more opportunities at Modal

See more jobs