F

Fireworks AI

AI inference platform for model deployment

Member of Technical Staff - Data Infrastructure

Platform EngineeringConfirmed live in the last 24 hours
Full-timeSan Mateo, CA, USA$175k - $220k /yrHybrid

About the Job

Requirements

  • A bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
  • At least 5 years of experience designing, building, and operating storage, caching, or data infrastructure in production at scale.
  • Strong software development skills in C/C++, Rust, or Go, with experience writing performance-critical data path code; Python or Go for automation.
  • Deep understanding of distributed storage fundamentals, including consistency models, replication and consensus such as Raft or Paxos, metadata scaling, caching, and failure recovery.
  • Hands-on experience with Kubernetes, including CSI, to mount high-performance volumes into ephemeral GPU pods.
  • Experience deploying and operating storage clusters such as WEKA, VAST, Lustre, Ceph, or MinIO across clouds using infrastructure-as-code tools such as Terraform or Pulumi.
  • Proficiency with performance benchmarking and profiling tools such as fio, iperf3, NCCL tests, perf, and eBPF to identify and resolve bottlenecks across the kernel, network, cache, and storage backend.

Responsibilities

  • Build a unified, high-performance data layer spanning parallel file systems, object storage, distributed caches, and key-value stores across multiple clouds.
  • Ensure datasets, checkpoints, model weights, and KV cache are placed where needed to support GPU workloads at scale.
  • Develop systems so training jobs can start without a data-staging step and inference replicas can cold-start without waiting on model-weight downloads.
  • Automate data placement, replication, and movement across storage systems and clouds.

Desired Qualifications

  • Experience as a core contributor or owner of a storage, caching, or key-value system, either in-house or open source, such as Ceph, Alluxio, JuiceFS, RocksDB, FoundationDB, TiKV, Redis/Dragonfly, SeaweedFS, or MinIO.
  • Experience with high-performance computing or large-scale AI clusters, such as Slurm or Kubernetes GPU pools, and familiarity with AI I/O patterns such as checkpoint bursts, random dataset reads, and model-weight loading for inference cold starts.
  • Familiarity with Linux internals, including kernel I/O paths, POSIX semantics, page cache behavior, io_uring/SPDK, and OS-level tuning such as sysctl, I/O schedulers, and NUMA.
  • Familiarity with high-performance networking, including RDMA, RoCE v2, InfiniBand, and GPUDirect Storage.
  • Experience moving, replicating, or caching petabyte-scale datasets across clouds such as AWS, GCP, and specialized neoclouds, with attention to egress cost and consistency.
  • Preference for software-defined storage over proprietary hardware appliances.

About the Company

Fireworks AI

AI inference platform for model deployment

Fireworks AI provides an AI inference platform that helps organizations run, customize, and deploy machine learning models. It supports deployment, fine-tuning, and inference workflows, with access to open-source models and on-demand deployment options through a subscription model. The platform enables users to configure and optimize models for production environments, manage variants, and scale AI workloads while controlling costs. Unlike some competitors, the emphasis is on end-to-end production-grade inference and fine-tuning across a range of clients, from tech firms to research institutions and enterprises, with tools tailored for rapid deployment and cost efficiency. The long-term goal is to expand the use of AI in production by building compound AI systems, growing the team, and delivering broader platform capabilities that accelerate AI adoption in real-world settings.

Company size
201-500
Company stage
Series D
Total funding
$1.8B
Headquarters
Redwood City, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at Fireworks AI

See more jobs