A

Arena Intelligence

Crowdsourced LLM evaluation and comparison platform

Full Stack Software Engineer

Full-Stack EngineeringConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USANo salary listedIn-person

About the Job

Requirements

  • At least 3 years of software engineering experience, focused on enterprise or developer-facing product development.
  • Experience building user-facing web applications across frontend, backend/API, and database layers in any stack, with understanding of the request lifecycle across layers.
  • Ability to explain technical decisions clearly, distinguish individual work from the team's work, and proactively share context.
  • Evidence of shipping and iterating on a feature, including explaining the problem, solution, code, post-launch outcome, and what could be changed.
  • A product engineering orientation focused on whether the product works for users, not only whether the code is clean.
  • Genuine curiosity about AI evaluation and Arena's mission, including familiarity with the product and ability to explain why the domain matters.

Responsibilities

  • Own features from technical scoping through deployment and post-launch iteration, ensuring they work.
  • Design and extend schemas, APIs, and business logic to support new product capabilities.
  • Ship high-quality product code across the stack.
  • Use real user feedback, data, direct user contact, or product instincts to improve shipped features.
  • Work with machine learning researchers to bring research services into production for product development.
  • Collaborate with design, product, and engineering to determine what to build.
  • Identify and advocate for improvements to development, testing, and deployment practices.

Desired Qualifications

  • Familiarity with Next.js, React, TypeScript, Tailwind, ShadCN, HonoJS, Postgres, or Vitest.
  • Experience with Supabase or Vercel's AI SDK.
  • Experience determining what to build without product management or design support by talking to users or examining data.

About the Company

Arena Intelligence

Crowdsourced LLM evaluation and comparison platform

Arena Intelligence provides a crowdsourced, open platform for evaluating large language models (LLMs) by running head-to-head comparisons of two anonymous models on user prompts. Users vote on the better response and, after voting, model identities are revealed; the results generate large-scale preference data used to compute Elo ratings published on a public leaderboard. Originating from LMSYS and UC Berkeley’s Sky Computing Lab as Chatbot Arena, the project evolved into a company and rebranded to Arena, with $100 million seed funding in 2024 to scale the platform. The underlying framework, FastChat, remains open source, including the user interface and serving backend. Arena differentiates itself by providing a transparent, real-world benchmarking method that aggregates community-driven judgments and offers analytics to AI labs and enterprises, aiming to guide model development with observable performance data.

Company size
51-200
Company stage
Series B
Total funding
$450M
Headquarters
San Francisco, CA
Founded
2025

Recently Posted Jobs

Explore more opportunities at Arena Intelligence

See more jobs