O

OpenRouter

Unified API router for 400+ LLMs

Product Manager - Provider Marketplace

Technical Product ManagementConfirmed live in the last 24 hours
Full-timeRemote in USANo salary listedRemote

About the Job

Requirements

  • At least 5 years of product management, technical founder, or marketplace systems experience building products at the intersection of algorithmic decision-making, economics, and infrastructure.
  • Experience with a two-sided marketplace, exchange, or price-matching engine, including an understanding of liquidity, price discovery, supply-demand balancing, and trust systems.
  • Prior software engineering experience, Computer Science study, or equivalent technical depth; understand API design and engineering constraints, and partner closely with engineers to scope, sequence, and ship complex projects iteratively.
  • Understand LLM inference stacks, including caching behavior, batching, and quantization decisions that affect cost and performance, and be able to engage with lab and inference-provider engineers.
  • Use coding agents to analyze data, prototype workflows, and validate specifications before requesting engineering time.
  • Model margin and capacity tradeoffs and design incentives that work for customers, providers, and the platform.
  • Turn complex technical and economic problems into clear written strategies, communicate directly with users and partners, scope work intelligently, and ship quickly.

Responsibilities

  • Own the Provider Marketplace roadmap across the provider dashboard, self-serve APIs, onboarding pipelines, and the prioritization, pricing, and quality mechanisms that govern network traffic.
  • Design, test, and scale new ways to match inference supply and demand, including auctions, committed capacity, and dynamic pricing.
  • Build buyer-side purchasing controls and provider-side capacity tools to make new markets liquid and easy to adopt.
  • Define inference prioritization and service tiers, including priority lanes, dedicated enterprise capacity, and flex tiers, balancing customer reliability, provider margins, and OpenRouter’s business model.
  • Build automated feedback loops, including continuous evaluations, routing scorecards, and real-time failure diagnostics, so providers can understand traffic outcomes and fix regressions without filing a ticket.
  • Partner with Engineering, Provider Development, and Provider Operations to convert manual onboarding, model staging, pricing updates, and health checks into self-serve APIs.
  • Analyze request logs, routing metrics, and unit economics to identify unmet demand, stranded capacity, or broken incentives, then turn findings into specifications and shipped product.

Desired Qualifications

  • Experience at an inference provider, AI lab, neo-cloud, or GPU cloud, or building infrastructure for model serving and routing.
  • Hands-on experience designing auction mechanisms, spot or batch compute markets, service-level agreement tiers, or dynamic pricing models.
  • A track record building business-to-business seller or partner tooling, self-serve onboarding funnels, and partner analytics dashboards.

About the Company

OpenRouter

Unified API router for 400+ LLMs

OpenRouter provides a single OpenAI-compatible API that lets developers access and switch between 400+ models from 60+ providers, acting as an LLM router and aggregator. It routes each prompt to the best model based on price, latency, and performance with about 25ms of overhead, and handles unified billing, spend tracking, automatic failover, and enterprise features like zero-logging and the option to use a company’s own keys. It differentiates itself by offering broad multi-model access through one API, real-time usage data and leaderboards, and privacy controls that support enterprise needs, avoiding vendor lock-in. Its goal is to simplify the fragmented AI model ecosystem and provide dependable, multi-model access and transparent usage data for developers and enterprises.

Company size
51-200
Company stage
Acquired
Total funding
$153M
Headquarters
New York City, New York
Founded
2023

Recently Posted Jobs

Explore more opportunities at OpenRouter

See more jobs