B

Baseten

Runs AI models for production software

Software Engineer - Storage Systems, Agent Infra

Systems Software EngineeringConfirmed live in the last 24 hours
Full-timeHybrid

About the Job

Requirements

  • Strong systems programming background in Go, Rust, and/or C/C++, with comfort reading kernel code.
  • Deep understanding of Linux filesystem and storage internals, including VFS, page cache, dentry and inode caches, FUSE, the block I/O stack, fsync semantics, and crash consistency.
  • Hands-on experience building distributed storage systems, content-addressable storage, or large-scale caching infrastructure.
  • Experience profiling I/O, memory, and RPC bottlenecks and optimizing tail latency in production.
  • Ability to debug correctness bugs that only appear under concurrency or partial failure.
  • Ability to move quickly and own a problem end to end on a small team.

Responsibilities

  • Design and implement core Agent Drive features, including metadata replication, volume placement, garbage collection, and FUSE client behavior.
  • Solve multi-attach correctness, including cache coherency across many FUSE mounts of the same drive, dentry and inode invalidation, write ordering, and crash consistency.
  • Optimize tail latency on read and write paths, including page cache strategy, writeback, prefetch, and metadata RPC batching.
  • Build tenant isolation into the storage layer, including quota enforcement, blast-radius containment, and noisy-neighbor mitigation.
  • Own the storage side of sandbox startup and resume performance.
  • Build durable block storage for sandboxes alongside other Baseten storage teams.
  • Build observability into every layer, drive storage incidents end to end, and turn each incident into a permanent fix.
  • Contribute upstream to the open-source storage projects the team builds on.

Desired Qualifications

  • Experience with a distributed filesystem or object store such as JuiceFS, CephFS, or S3-compatible storage, or contributions to those projects.
  • Knowledge of consensus and replication protocols such as Raft, leader leases, and quorum reads.
  • Experience with snapshot, clone, and copy-on-write filesystem features.
  • Experience operating multi-tenant storage with hard isolation requirements.
  • Familiarity with Linux performance tooling such as eBPF, io_uring, perf, ftrace, and blktrace.

About the Company

Baseten

Runs AI models for production software

Baseten runs AI models for software companies that need fast, reliable responses inside their products, from text generation to speech and image processing. Its Inference Stack combines optimized model runtimes with infrastructure that deploys, serves, and monitors custom or open models in production. Teams package models with its open source Truss tool, while Model APIs let developers test ready-to-use models and Training runs jobs that adapt models to their own data. Customers pay for computing time or tokens processed, with negotiated plans for larger deployments and support needs. Baseten was founded in 2019 and is headquartered in San Francisco.

Company size
201-500
Company stage
Series F
Total funding
$2.1B
Headquarters
San Francisco, CA
Founded
2019

Recently Posted Jobs

Explore more opportunities at Baseten

See more jobs