A

Artificial Analysis

Independent AI model and API benchmarks

Product Manager - AI Hardware

Technical Product ManagementConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USA

About the Job

Requirements

  • At least 3 years of professional experience, including at least 2 years at an artificial intelligence chip company or similar organization.
  • Strong analytical and critical thinking skills.
  • Proficiency in Python and data analysis.
  • Deep familiarity with artificial intelligence accelerators and the inference software stack, such as CUDA, TensorRT, and vLLM or similar serving frameworks.
  • Understanding of inference economics, including cost-per-token, utilization, and deployment trade-offs.
  • Demonstrable interest in and knowledge of frontier artificial intelligence, with informed opinions about the direction of artificial intelligence.

Responsibilities

  • Design and execute performance benchmarks across graphics processing units, tensor processing units, and custom inference silicon, measuring throughput, latency, and price-performance.
  • Develop and maintain evaluation frameworks for measuring artificial intelligence hardware performance and efficiency, extending products such as AA-AgentPerf and covering tokens per second, time-to-first-token, and total cost of ownership.
  • Analyze how cost-per-token, utilization, and hardware choice interact, and translate the findings into analysis for deployment and procurement decisions.
  • Work with hardware companies to benchmark their latest silicon, shape benchmarking methodology, and establish industry measurement standards.
  • Produce reports and data visualizations communicating hardware performance and economics to technical and non-technical audiences.
  • Use artificial intelligence tools in an AI-native workflow to increase leverage in artificial intelligence benchmarking.

Desired Qualifications

  • Experience in engineering, product, performance, or technical roles at artificial intelligence accelerator or inference hardware companies.
  • Experience with GPU and accelerator teams at NVIDIA, AMD, Google, Amazon, Qualcomm, or similar organizations.
  • Experience at inference infrastructure companies working closely with silicon.
  • Experience benchmarking GPUs, TPUs, and custom silicon or working with AI accelerator companies such as Cerebras, Groq, SambaNova, d-Matrix, Etched, MatX, or Tenstorrent.

About the Company

Artificial Analysis

Independent AI model and API benchmarks

Independent benchmarking and analysis of AI models and API hosting providers, with benchmarks and leaderboards across intelligence, coding agents, image/speech/video, and inference metrics to help teams choose the right model and provider. It publishes data-driven reports like Intelligence Index releases, capability indexes, and trend analyses, packaging benchmarks as insights and data products for AI buyers. Unlike others, it does not host or sell models, focusing on unbiased evaluation and transparent metrics. The goal is to help AI buyers understand the landscape and select AI models and API providers that fit their use case.

Company size
51-200
Company stage
Seed
Total funding
$250K
Headquarters
Newark, DE
Founded
2024

Recently Posted Jobs

Explore more opportunities at Artificial Analysis

See more jobs