A

Arena Intelligence

Crowdsourced LLM evaluation and comparison platform

Product Designer - Product

Product DesignConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USANo salary listedIn-person

About the Job

Requirements

  • At least 5 years of Product Design experience working on a consumer- or developer-facing application, with a portfolio showcasing visual design craft, product experience, and measurable impact.
  • Ability to make appropriate tradeoffs between short-term and long-term goals, informed by business and/or user needs.
  • Strong interaction, visual, and design-system skills.
  • Very strong proficiency in Figma.
  • Proficiency in a prototyping tool of choice.
  • A prototype-first mindset, including building and testing prototypes to inform design decisions.
  • Comfort with ambiguity and simplifying complex ideas.
  • Strong writing skills, including comfort writing or editing a product requirements document, and strong visual, verbal, and written storytelling skills.

Responsibilities

  • Lead the end-to-end design process for new features and products, from prototyping ideas and writing proposals and specifications to working with engineering on scope and implementation, tracking feedback and data, and iterating after launch.
  • Deeply understand the high-expectation customer, why they value the product, and how they use it.
  • Understand business goals and user needs, and form a strong point of view on how to improve the user experience and grow the business.
  • Monitor user feedback and analytics, identify trends, and use insights to prioritize work and improve the product.
  • Help develop and expand the design system to ensure consistency and quality across product surfaces.
  • Influence the design team's culture and processes and drive product vision.

Desired Qualifications

  • Experience building 0-to-1 products or working at or with early-stage startups is ideal.

About the Company

Arena Intelligence

Crowdsourced LLM evaluation and comparison platform

Arena Intelligence provides a crowdsourced, open platform for evaluating large language models (LLMs) by running head-to-head comparisons of two anonymous models on user prompts. Users vote on the better response and, after voting, model identities are revealed; the results generate large-scale preference data used to compute Elo ratings published on a public leaderboard. Originating from LMSYS and UC Berkeley’s Sky Computing Lab as Chatbot Arena, the project evolved into a company and rebranded to Arena, with $100 million seed funding in 2024 to scale the platform. The underlying framework, FastChat, remains open source, including the user interface and serving backend. Arena differentiates itself by providing a transparent, real-world benchmarking method that aggregates community-driven judgments and offers analytics to AI labs and enterprises, aiming to guide model development with observable performance data.

Company size
51-200
Company stage
Series B
Total funding
$450M
Headquarters
San Francisco, CA
Founded
2025

Recently Posted Jobs

Explore more opportunities at Arena Intelligence

See more jobs