C

Cloudflare

Secures websites and runs apps on its network

Senior Systems Engineer - AI Gateway

Backend EngineeringConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • At least 5 years of experience building and operating production systems; experience in AI infrastructure, developer platforms, cloud infrastructure, edge/proxy systems, high-scale APIs, or distributed systems is desirable.
  • Strong systems engineering fundamentals in networking, APIs, reliability, observability, data modeling, performance, and operational tradeoffs.
  • Experience designing or scaling distributed systems where latency, throughput, availability, and correctness matter.
  • Ability to work across API design and product surfaces, backend services, queues, storage systems, control planes, and performance-critical code.
  • Experience using and building APIs, SDKs, dashboards, command-line interfaces, documentation, and internal platforms.
  • Ability to write design documents, explain tradeoffs, review architecture, and align engineers and product partners around a practical path forward.
  • Ability to prototype quickly, ship incrementally, and improve systems in production.
  • Operational judgment to build observable, resilient, and recoverable systems.
  • Comfort using AI-native development workflows and curiosity about using agents, tools, and automation to improve engineering productivity.

Responsibilities

  • Build core AI Gateway systems handling high-volume inference traffic across providers, models, and Cloudflare’s global network.
  • Design and implement APIs, routing primitives, observability features, controls, and developer workflows for a reliable, easy-to-adopt AI Gateway.
  • Work across product and infrastructure boundaries with Workers AI, Agents, and the Developer Platform organization to create a coherent AI platform.
  • Turn ambiguous product and technical ideas into prototypes, design documents, shipped features, and measurable production improvements.
  • Improve reliability, performance, cost efficiency, and debuggability for latency-sensitive AI workloads.
  • Build software and software-development tooling, including agents, tests, harnesses, evaluation loops, operational tools, and internal context.
  • Improve developer experience across error messages, SDKs, dashboard flows, documentation, examples, and API details.
  • Mentor engineers through design review, code review, debugging, and technical leadership without people-management authority.

Desired Qualifications

  • Experience building AI/ML infrastructure, inference platforms, model gateways, LLM-powered applications, or provider abstraction layers.
  • Experience building developer-facing APIs, SDKs, command-line interfaces, dashboards, or platform products at scale.
  • Hands-on experience with proxy, edge, gateway, routing, or traffic-management systems.
  • Familiarity with model providers, model capabilities, agent frameworks, inference patterns, and common developer challenges in the AI ecosystem.
  • Experience with cost controls, rate limits, caching, retries, fallbacks, evaluation, or observability for AI workloads.
  • Experience with TypeScript, Go, Rust, or similar systems/backend languages.
  • Experience building or heavily customizing an agentic development environment, including custom agents, harnesses, tools, or workflows.
  • Experience building with AI Gateway, Workers AI, or a competing product.
  • A track record of writing publicly about developer tools, infrastructure, systems, or AI products.

About the Company

Cloudflare

Secures websites and runs apps on its network

Cloudflare operates a network that protects websites, delivers online content and runs applications closer to their users. Businesses connect websites and internal systems to its services to filter malicious traffic, control access and improve performance, with security and computing running on shared infrastructure. Developers combine application code, object storage and databases with the network used for content delivery and traffic protection. Cloudflare earns revenue from subscriptions and usage charges, with free plans for basic features and negotiated contracts for larger organizations. Cloudflare was founded in 2009 and is headquartered in San Francisco, California.

Company size
1,001-5,000
Company stage
IPO
Headquarters
San Francisco, CA
Founded
2009

Recently Posted Jobs

Explore more opportunities at Cloudflare

See more jobs