A

Arena Intelligence

Crowdsourced LLM evaluation and comparison platform

Staff Software Engineer - Cloud Infrastructure

Cloud EngineeringPosted on Nov 13
Full-timeCalifornia, USANo salary listedIn-person

About the Job

Requirements

  • At least 6 years of experience building and operating production cloud infrastructure, including owning architecture decisions at a fast-growing company.
  • Deep hands-on experience with GCP and/or AWS, Kubernetes, and Terraform or a similar infrastructure-as-code tool.
  • Strong experience with cloud identity and secrets at scale, including OIDC and workload identity federation, IAM design, secret managers, and key rotation.
  • Experience running serverless or edge platforms, such as Vercel, Cloud Run, Lambda, or Cloudflare Workers, and the judgment to know when to use them.
  • Experience with queues, workflow engines, or durable execution systems for long-running and asynchronous workloads.
  • A track record of leading infrastructure through incidents and turning lessons into lasting improvements.
  • Clear written communication and the ability to explain trade-offs to engineers and leadership.

Responsibilities

  • Own Arena's cloud architecture end to end, including hosting, compute, networking, and the infrastructure on which its products are built.
  • Decide and execute on hosting and workload strategy, including serverless and edge platforms, containers and Kubernetes, and durable execution for long-running AI agent workflows.
  • Build identity and access systems using workload identity, least-privilege IAM, short-lived credentials, and centralized, audited secrets management.
  • Design network boundaries, private connectivity, and egress controls for databases and services.
  • Manage all infrastructure as code with clear ownership, CI/CD, and review practices.
  • Establish reliability practices, including SLOs, monitoring and alerting, on-call, incident response, and post-incident follow-through.
  • Keep infrastructure cost and risk visible and improve them continuously.
  • Help hire and mentor the infrastructure team as it grows.

Desired Qualifications

  • Experience building infrastructure for AI products, such as sandboxed code execution, model serving, or GPU clusters.
  • Experience with data platforms such as Databricks and with Postgres at scale.
  • Background in cloud security, detection engineering, or security posture tooling.
  • Experience as the first infrastructure hire at a fast-growing startup.

About the Company

Arena Intelligence

Crowdsourced LLM evaluation and comparison platform

Arena Intelligence provides a crowdsourced, open platform for evaluating large language models (LLMs) by running head-to-head comparisons of two anonymous models on user prompts. Users vote on the better response and, after voting, model identities are revealed; the results generate large-scale preference data used to compute Elo ratings published on a public leaderboard. Originating from LMSYS and UC Berkeley’s Sky Computing Lab as Chatbot Arena, the project evolved into a company and rebranded to Arena, with $100 million seed funding in 2024 to scale the platform. The underlying framework, FastChat, remains open source, including the user interface and serving backend. Arena differentiates itself by providing a transparent, real-world benchmarking method that aggregates community-driven judgments and offers analytics to AI labs and enterprises, aiming to guide model development with observable performance data.

Company size
51-200
Company stage
Series B
Total funding
$450M
Headquarters
San Francisco, CA
Founded
2025

Recently Posted Jobs

Explore more opportunities at Arena Intelligence

See more jobs