LiteLLM

LiteLLM

Open-source LLM gateway routing multiple providers

Overview

LiteLLM provides an open-source LLM gateway and Python SDK that connects to 100+ LLM APIs and standardizes responses in an OpenAI-compatible format, acting as a translator across AI schemas to reduce vendor lock-in. Built on Python and FastAPI, it offers routing features like load balancing, automatic fallbacks, and regional prioritization, plus a centralized dashboard for cost and token usage. The platform emphasizes enterprise control with observability integrations (Prometheus, Langfuse, Sentry) and an open-core model where advanced features such as SSO, RBAC, and team budgets are available in a paid Enterprise Edition. Its target customers are large organizations and fast-growing companies in regulated industries needing data residency and strict operational governance.

YC Company
Significant Headcount Growth

About LiteLLM

Simplify's Rating
Why LiteLLM is rated
B-
Rated B on Competitive Edge
Rated B on Growth Potential
Rated C on Differentiation

Industries

Data & Analytics

Enterprise Software

AI & Machine Learning

Company Size

11-50

Company Stage

Seed

Total Funding

$630K

Headquarters

San Francisco, California

Founded

2023

Get referred to LiteLLM

See people who can refer or advise you

Simplify Jobs

Simplify's Take

What believers are saying

  • LiteLLM still reports massive developer adoption and active maintenance in 2026.
  • CrowdStrike partnership validates enterprise demand for secure AI traffic control at the gateway.
  • New CI/CD v2, rotated credentials, and recertification efforts reduce near-term operational fallout.

What critics are saying

  • March 24, 2026 PyPI compromise exposed credentials and triggered emergency release controls.
  • April 2026 Texas litigation named BerriAI over supply-chain security and compliance claims.
  • Open-source gateway commoditization and security scrutiny can push enterprises to Portkey or Kong.

What makes LiteLLM unique

  • LiteLLM unifies 140-plus model APIs behind one OpenAI-compatible interface in 2026.
  • Its open-source proxy and Python SDK sit inside many agent frameworks.
  • CrowdStrike added LiteLLM to its June 2026 Open Gateway Ecosystem.

Help us improve and share your feedback! Did you find this helpful?

Funding

Total Funding

$630k

Below

Industry Average

Funded Over

2 Rounds

Notable Investors:
Seed funding is usually the first official round after pre-seed, when a startup has a prototype or concept. It’s typically used to develop the product, test the market, and start building the team. Investors here are often angel investors or early-stage venture capitalists.
Seed Funding Comparison
Below Average

Industry standards

$3.3M
$1.5M
Slack
$2M
Netflix
$2.3M
Instacart
$3M
Robinhood

Benefits

Health Insurance

Dental Insurance

Vision Insurance

401(k) Company Match

Growth & Insights and Company News

Headcount

6 month growth

0%

1 year growth

50%

2 year growth

-6%
Founderland
Aug 6th, 2026
LiteLLM raises $1.6M seed funding amid security challenges, hits $7M ARR

BerriAI, the San Francisco startup behind LiteLLM, has raised $1.6 million in seed funding from Y Combinator, Gravity Fund, and Pioneer Fund. The company builds an open-source gateway connecting developers to over 100 large language model APIs, handling routing, fallbacks, and rate limiting across providers like OpenAI and Anthropic. LiteLLM has accumulated more than 50,000 GitHub stars and routes hundreds of millions of API calls daily. BerriAI reports $7 million in annual recurring revenue, with customers including NASA, Adobe, Netflix, Stripe, and Nvidia. However, the company faced significant security challenges in March when a supply chain attack compromised its PyPI releases. Additional vulnerabilities emerged between spring and summer, leading to litigation filed in April 2026 in Texas federal court. Despite these setbacks, BerriAI recently open-sourced its Agent Platform and joined CrowdStrike's Open Gateway Ecosystem, continuing to compete with rivals like Portkey and Helicone in the AI gateway market.

PR Newswire
Apr 23rd, 2026
Akto partners with Langchain, Portkey, and LiteLLM to embed AI agent security across enterprise infrastructure

Akto, an AI agent security platform, has announced partnerships with Langchain, Portkey, TrueFoundry, Arcade, and LiteLLM to provide real-time defence against prompt injection, uncontrolled tool access and data leakage in AI agent deployments. The integrations embed Akto's runtime guardrails and observability directly into AI infrastructure platforms that enterprises already use, requiring no additional implementation work. This addresses a critical gap, as 79% of enterprises reportedly have limited visibility into AI agent runtime execution. The partnerships enable automated protection across the AI agent stack, from gateways and runtimes to frameworks and deployment platforms. Akto's technology inspects tool calls and responses in real-time, blocking injections, redacting sensitive data and enforcing policies before agents perform actions. The company raised $295 million across three funding rounds.

The Register
Mar 30th, 2026
Telnyx compromised in TeamPCP's second PyPI supply-chain attack after Trivy breach

A cybercrime group linked to the Trivy supply-chain attack has compromised Telnyx's Python SDK on PyPI, planting credential-stealing malware on developers' systems. Security firm Ox Security identified the attackers as TeamPCP, the same crew behind recent malicious LiteLLM packages. The compromised Telnyx versions (4.87.1 and 4.87.2) downloaded malware disguised as a .wav file that was decoded and executed on target machines. Telnyx, which sees over 34,000 weekly PyPI downloads, confirmed only its Python package was affected and has resolved the issue. The company recommends treating any environment running the affected versions as compromised and rotating exposed credentials. None of Telnyx's infrastructure, networking or other services were impacted.

PR Newswire
Mar 26th, 2026
Point Wild releases free vulnerability scanner within 24 hours of LiteLLM supply chain attack

Point Wild has released a free security tool, who-touched-my-packages, within 24 hours of a supply chain attack on the LiteLLM Python package. The attack, affecting a package with three million daily downloads, enabled exfiltration of SSH keys, cloud credentials and API tokens, with approximately 500,000 credentials already confirmed stolen. The scanner uses behavioural analysis and AI-powered classification to detect zero-day supply chain attacks, including credential harvesting, data exfiltration and obfuscated code. Unlike traditional security tools that rely on known vulnerability databases, it identifies malicious behaviour in real time through dependency graphing, local CVE cross-referencing and active behavioural scanning powered by agentic AI. The tool is available immediately via API, CLI command or GitHub integration. Point Wild released it for free to support the developer community amid heightened software supply chain concerns.

TechCrunch
Sep 28th, 2023
Chatgpt: Everything You Need To Know About The Ai-Powered Chatbot

ChatGPT, OpenAI’s text-generating AI chatbot, has taken the world by storm. It’s able to write essays, code and more given short text prompts, hyper-charging productivity. But it also has a more…nefarious side.In any case, AI tools are not going away — and indeed has expanded dramatically since its launch just a few months ago. Major brands are experimenting with it, using the AI to generate ad and marketing copy, for example.And OpenAI is heavily investing in it. ChatGPT was recently super-charged by GPT-4, the latest language-writing model from OpenAI’s labs. Paying ChatGPT users have access to GPT-4, which can write more naturally and fluently than the model that previously powered ChatGPT

Recently Posted Jobs

Sign up to get curated job recommendations

LiteLLM is Hiring for 11 Jobs on Simplify!

Find jobs on Simplify and start your career today

Don't see your dream role? Check out thousands of other roles on Simplify. Browse all jobs →