C

Cloudflare

Secures websites and runs apps on its network

Model Operations Lead - AI Gateway

Engineering LeadershipConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • Experience hiring, managing, and growing engineers or operators, giving direct feedback, delegating ownership, and expanding scope without becoming a bottleneck.
  • A proven track record of taking technical launches or integrations from ambiguity to production across teams and partners.
  • Hands-on ability to write TypeScript, Python, or Rust, read API documentation, inspect endpoints, and debug using terminal tools such as logs and cURL.
  • Deep familiarity with new models, labs, and inference providers.
  • Hands-on understanding of streaming, tool calling, structured outputs, rate limits, token pricing, and provider-specific model behavior variations.
  • Data-driven product instincts to advocate for adding, modifying, or retiring catalog items.
  • An SRE approach to defining, measuring, and alerting on service health, managing incidents calmly, and fixing root causes.
  • Daily experience building with agents, including scoping work, verifying outputs, and integrating deterministic checks or human judgment appropriately.
  • Meticulous attention to detail regarding model IDs, context limits, per-token prices, and response fields.

Responsibilities

  • Build and lead the models team responsible for running the catalog and developing its intelligence; provide ownership and feedback and develop leads to run their own areas.
  • Run model launches end-to-end by scoping integrations, coordinating testing and evaluations, confirming pricing, metering, capacity, and security, preparing documentation and announcements, and preparing day-zero launches to ship quickly.
  • Ensure published model capabilities, limits, versions, and prices match what developers receive; detect regressions such as broken tool calling, truncated streams, quantization changes, and usage or pricing mismatches before customers are affected.
  • Own evaluations, capability maps, and per-task rankings behind auto-routing profiles and model recommendations; ensure they measure what they claim and connect regressions to routing decisions.
  • Set direction on which models belong in the catalog, which routing profiles to ship, and what market intelligence to publish, based on usage, quality, reliability, and cost data; turn findings into roadmap input.
  • Maintain an operating cadence and single source of truth for work in flight, ownership, blockers, and upcoming releases; keep Engineering, Product, Partnerships, and other stakeholders aligned and informed without status meetings.
  • Automate repeatable steps through scripts, tools, and agent workflows, including endpoint validation, evaluation runs, catalog and pricing reconciliation, regression detection, and provider follow-ups; reduce manual effort per launch as the catalog grows.
  • Ensure new models launch on day zero with tested capabilities, accurate pricing, documentation, and a clear routing-eligibility decision.
  • Ensure the catalog reflects reality and proactively identify underperforming models or providers before customers notice.
  • Deliver auto-routing that measurably improves cost or quality for users compared with a fixed model choice.
  • Build and maintain trusted rankings and recommendations grounded in sound methodology.
  • Set clear expectations for providers while keeping Engineering, Product, Partnerships, and other stakeholders aligned.
  • Provide clear team ownership and direction so members know what is next, who owns it, and how they can grow into larger roles.
  • Continuously reduce human effort required for each launch, evaluation, and routing update through tools and automation.

Desired Qualifications

  • Experience at an inference provider, model lab, model router, evaluation platform, or API company.
  • Background in evaluations, ranking or recommendation systems, observability, metering, or usage-based billing.
  • Familiarity with Cloudflare Workers, AI Gateway, Workers AI, or Replicate.
  • Relevant domain background in engineering management, SRE, partner engineering, evaluations or applied machine learning, technical program management, or solutions engineering.

About the Company

Cloudflare

Secures websites and runs apps on its network

Cloudflare operates a network that protects websites, delivers online content and runs applications closer to their users. Businesses connect websites and internal systems to its services to filter malicious traffic, control access and improve performance, with security and computing running on shared infrastructure. Developers combine application code, object storage and databases with the network used for content delivery and traffic protection. Cloudflare earns revenue from subscriptions and usage charges, with free plans for basic features and negotiated contracts for larger organizations. Cloudflare was founded in 2009 and is headquartered in San Francisco, California.

Company size
1,001-5,000
Company stage
IPO
Headquarters
San Francisco, CA
Founded
2009

Recently Posted Jobs

Explore more opportunities at Cloudflare

See more jobs