F

Fireworks AI

AI inference platform for model deployment

Member of Technical Staff - Enterprise Foundations

Backend EngineeringConfirmed live in the last 24 hours
Full-timeNew York, NY, USA$165k - $240k /yrHybrid

About the Job

Requirements

  • At least 4 years of building and operating production backend or distributed systems at scale.
  • Strong server-side engineering skills in Go, Python, C++, TypeScript, or a similar language, and willingness to work outside the primary layer to deliver a feature.
  • Experience designing APIs and data models that other teams build on, and evolving them under live traffic without breaking callers.
  • Hands-on depth in at least one major cloud (AWS, GCP, or Azure), including IAM and workload identity, KMS, object storage, and VPC networking.
  • A track record of owning an ambiguous, cross-team workstream from requirements through production.
  • Willingness to work directly with customers.

Responsibilities

  • Own foundational capabilities end to end, from data model and API through control plane, runtime, SDK/CLI, and console, and migrate live systems onto them.
  • Design primitives for large customers, including organizations and sub-accounts, groups, roles, and service identities, and connect them to enterprise directories through federation and provisioning (SSO, SCIM).
  • Design multi-tenant authorization, policy enforcement, and audit systems that meet enterprise security requirements.
  • Make usage metering, spend controls, and billing correct and legible at scale so customers can reconcile the numbers against their own.
  • Own data isolation and key management, including customer-managed encryption keys across AWS, GCP, and Azure, threaded through datasets, fine-tuning, RL, checkpoints, models, and inference.
  • Deploy and operate Fireworks inside a customer's own cloud, and solve data residency and regional isolation for customers with hard constraints.
  • Use AI tooling aggressively and automate work.
  • Engage in customer conversations and security reviews, determine product requirements, and build features that support enterprise deals.

Desired Qualifications

  • Experience with enterprise identity and tenancy, including SSO, SCIM provisioning, RBAC/ABAC, audit logging, and organization modeling.
  • Experience with metering, quotas, or billing systems where correctness is customer-visible.
  • Experience with applied cryptography and key management, including envelope encryption, KMS, and threat modeling.
  • Kubernetes depth and infrastructure-as-code fluency, including Terraform and GitOps.
  • Familiarity with LLM inference and fine-tuning.

About the Company

Fireworks AI

AI inference platform for model deployment

Fireworks AI provides an AI inference platform that helps organizations run, customize, and deploy machine learning models. It supports deployment, fine-tuning, and inference workflows, with access to open-source models and on-demand deployment options through a subscription model. The platform enables users to configure and optimize models for production environments, manage variants, and scale AI workloads while controlling costs. Unlike some competitors, the emphasis is on end-to-end production-grade inference and fine-tuning across a range of clients, from tech firms to research institutions and enterprises, with tools tailored for rapid deployment and cost efficiency. The long-term goal is to expand the use of AI in production by building compound AI systems, growing the team, and delivering broader platform capabilities that accelerate AI adoption in real-world settings.

Company size
201-500
Company stage
Series D
Total funding
$1.8B
Headquarters
Redwood City, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at Fireworks AI

See more jobs