A

Arena Intelligence

Crowdsourced LLM evaluation and comparison platform

Member of Security Staff – Privacy & Trust Ops Lead

Privacy & Data ProtectionConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USANo salary listed

About the Job

Requirements

  • A track record of building a privacy or compliance program where none existed.
  • Technical fluency to work directly with engineers on privacy and trust systems, read schemas, reason about data flows, and drive de-identification and data lifecycle control initiatives from requirements through product delivery.
  • Depth in GDPR and U.S. state privacy regimes, including the ability to conduct a Data Protection Impact Assessment and reason about controller/processor boundaries in ambiguous relationships.
  • Inside audit experience with SOC 2 and ideally ISO 27001, including ownership of evidence and control narratives.
  • Experience owning an external-party relationship with contractual obligations and responsibility for follow-through.
  • Experience on the commercial side of privacy, where the program gates revenue.
  • Experience owning a time-bound obligation such as mandated reporting, breach notification, or regulatory disclosure.
  • Judgment to assess actual risks and comfort reasoning from principles on regulatory questions without settled answers.

Responsibilities

  • Build and mature Arena's privacy, compliance, and trust operations program, determining what to prioritize.
  • Partner with Engineering to drive privacy and trust engineering initiatives, including de-identification, pseudonymous identifiers, and data lifecycle controls, from requirements through product delivery.
  • Operate the programs that implement Legal's determinations and make them evidenced and repeatable.
  • Own privacy operations end-to-end, including records of processing, data subject rights, retention, breach notification, and privacy notices.
  • Own compliance work for packaging and sharing Arena's data products externally.
  • Own the control framework portfolio, including SOC 2, ISO 27001, NIST CSF, and NIST AI RMF; continuous compliance monitoring; and a risk register with accountable business owners.
  • Own third-party risk management end-to-end and privacy for the API and gateway, including the sub-processor register supporting enterprise customer terms.
  • Manage model-provider compliance, including data processing terms, acceptable-use obligations, provider provenance and screening, and trust operations escalations.
  • Oversee trust and safety governance, including mandated reporting deadlines, evidence preservation, moderation effectiveness oversight, and enforcement policy.
  • Review vendor and provider onboarding before it proceeds.
  • Escalate refused risk treatments to the Executive Team.
  • Advise on major product and commercial decisions that touch trust, privacy, or data.
  • Sign off on compliance representations to customers, providers, auditors, and regulators.

Desired Qualifications

  • Experience working with or inside AI labs, model providers, or platforms with similar provider relationships.
  • Experience with NIST AI RMF, ISO 42001, or comparable AI governance work.
  • Trust and safety experience, especially mandated reporting regimes or consumer-scale platform integrity.
  • A privacy engineering background.

About the Company

Arena Intelligence

Crowdsourced LLM evaluation and comparison platform

Arena Intelligence provides a crowdsourced, open platform for evaluating large language models (LLMs) by running head-to-head comparisons of two anonymous models on user prompts. Users vote on the better response and, after voting, model identities are revealed; the results generate large-scale preference data used to compute Elo ratings published on a public leaderboard. Originating from LMSYS and UC Berkeley’s Sky Computing Lab as Chatbot Arena, the project evolved into a company and rebranded to Arena, with $100 million seed funding in 2024 to scale the platform. The underlying framework, FastChat, remains open source, including the user interface and serving backend. Arena differentiates itself by providing a transparent, real-world benchmarking method that aggregates community-driven judgments and offers analytics to AI labs and enterprises, aiming to guide model development with observable performance data.

Company size
51-200
Company stage
Series B
Total funding
$450M
Headquarters
San Francisco, CA
Founded
2025

Recently Posted Jobs

Explore more opportunities at Arena Intelligence

See more jobs