
Work Here?
LiteLLM provides an open-source LLM gateway and Python SDK that connects to 100+ LLM APIs and standardizes responses in an OpenAI-compatible format, acting as a translator across AI schemas to reduce vendor lock-in. Built on Python and FastAPI, it offers routing features like load balancing, automatic fallbacks, and regional prioritization, plus a centralized dashboard for cost and token usage. The platform emphasizes enterprise control with observability integrations (Prometheus, Langfuse, Sentry) and an open-core model where advanced features such as SSO, RBAC, and team budgets are available in a paid Enterprise Edition. Its target customers are large organizations and fast-growing companies in regulated industries needing data residency and strict operational governance.
Industries
Data & Analytics
Enterprise Software
AI & Machine Learning
Company Size
11-50
Company Stage
Seed
Total Funding
$630K
Headquarters
San Francisco, California
Founded
2023
See people who can refer or advise you
Help us improve and share your feedback! Did you find this helpful?
Total Funding
$630k
Below
Industry Average
Funded Over
2 Rounds
Industry standards
Health Insurance
Dental Insurance
Vision Insurance
401(k) Company Match
BerriAI, the San Francisco startup behind LiteLLM, has raised $1.6 million in seed funding from Y Combinator, Gravity Fund, and Pioneer Fund. The company builds an open-source gateway connecting developers to over 100 large language model APIs, handling routing, fallbacks, and rate limiting across providers like OpenAI and Anthropic. LiteLLM has accumulated more than 50,000 GitHub stars and routes hundreds of millions of API calls daily. BerriAI reports $7 million in annual recurring revenue, with customers including NASA, Adobe, Netflix, Stripe, and Nvidia. However, the company faced significant security challenges in March when a supply chain attack compromised its PyPI releases. Additional vulnerabilities emerged between spring and summer, leading to litigation filed in April 2026 in Texas federal court. Despite these setbacks, BerriAI recently open-sourced its Agent Platform and joined CrowdStrike's Open Gateway Ecosystem, continuing to compete with rivals like Portkey and Helicone in the AI gateway market.
Akto, an AI agent security platform, has announced partnerships with Langchain, Portkey, TrueFoundry, Arcade, and LiteLLM to provide real-time defence against prompt injection, uncontrolled tool access and data leakage in AI agent deployments. The integrations embed Akto's runtime guardrails and observability directly into AI infrastructure platforms that enterprises already use, requiring no additional implementation work. This addresses a critical gap, as 79% of enterprises reportedly have limited visibility into AI agent runtime execution. The partnerships enable automated protection across the AI agent stack, from gateways and runtimes to frameworks and deployment platforms. Akto's technology inspects tool calls and responses in real-time, blocking injections, redacting sensitive data and enforcing policies before agents perform actions. The company raised $295 million across three funding rounds.
A cybercrime group linked to the Trivy supply-chain attack has compromised Telnyx's Python SDK on PyPI, planting credential-stealing malware on developers' systems. Security firm Ox Security identified the attackers as TeamPCP, the same crew behind recent malicious LiteLLM packages. The compromised Telnyx versions (4.87.1 and 4.87.2) downloaded malware disguised as a .wav file that was decoded and executed on target machines. Telnyx, which sees over 34,000 weekly PyPI downloads, confirmed only its Python package was affected and has resolved the issue. The company recommends treating any environment running the affected versions as compromised and rotating exposed credentials. None of Telnyx's infrastructure, networking or other services were impacted.
Point Wild has released a free security tool, who-touched-my-packages, within 24 hours of a supply chain attack on the LiteLLM Python package. The attack, affecting a package with three million daily downloads, enabled exfiltration of SSH keys, cloud credentials and API tokens, with approximately 500,000 credentials already confirmed stolen. The scanner uses behavioural analysis and AI-powered classification to detect zero-day supply chain attacks, including credential harvesting, data exfiltration and obfuscated code. Unlike traditional security tools that rely on known vulnerability databases, it identifies malicious behaviour in real time through dependency graphing, local CVE cross-referencing and active behavioural scanning powered by agentic AI. The tool is available immediately via API, CLI command or GitHub integration. Point Wild released it for free to support the developer community amid heightened software supply chain concerns.
ChatGPT, OpenAI’s text-generating AI chatbot, has taken the world by storm. It’s able to write essays, code and more given short text prompts, hyper-charging productivity. But it also has a more…nefarious side.In any case, AI tools are not going away — and indeed has expanded dramatically since its launch just a few months ago. Major brands are experimenting with it, using the AI to generate ad and marketing copy, for example.And OpenAI is heavily investing in it. ChatGPT was recently super-charged by GPT-4, the latest language-writing model from OpenAI’s labs. Paying ChatGPT users have access to GPT-4, which can write more naturally and fluently than the model that previously powered ChatGPT
Find jobs on Simplify and start your career today
Industries
Data & Analytics
Enterprise Software
AI & Machine Learning
Company Size
11-50
Company Stage
Seed
Total Funding
$630K
Headquarters
San Francisco, California
Founded
2023
Find jobs on Simplify and start your career today