L

LiteLLM

Open-source LLM gateway routing multiple providers

Founding Developer Relations

Full-Time
$150k - $220k/yr+ Equity + 401(k) Match
Mid
San Francisco, CA, USA
In Person
Solution EngineeringDeveloper Relations & Advocacy

About the job

Requirements
  • Experience in Developer Relations, Developer Advocacy, software engineering, solutions engineering, or another highly technical developer-facing role.
  • Ability to write working software and build examples in Python.
  • Ability to read an unfamiliar codebase, debug integrations, reproduce issues, and communicate clearly with engineers.
  • Ability to explain complex infrastructure concepts accurately and understandably.
  • Interest in engaging with developers and understanding how they build and operate software.
  • Strong product instincts to identify friction in APIs, workflows, examples, and documentation.
  • Ability to create sample applications, written tutorials, technical talks, workshops, and video.
  • Comfort serving as a visible external representative of a technical product and open-source project.
  • Ability to take ownership and begin shipping useful work without an existing playbook.
  • Focus on work that changes developer behavior, improves implementations, and produces meaningful product learning.
  • Ability to move quickly without compromising technical accuracy.
Responsibilities
  • Build and maintain runnable demos, sample applications, integrations, and reference architectures for real LiteLLM use cases.
  • Create technical guides, videos, workshops, launch demos, and deep dives that make complex capabilities understandable and usable.
  • Engage directly with developers through GitHub, community channels, livestreams, meetups, conferences, and other technical forums.
  • Partner with Product and Engineering on launches, providing examples, documentation, and a clear technical story for new capabilities.
  • Identify recurring questions and friction, then turn them into documentation, examples, product feedback, issues, or code contributions as appropriate.
  • Explore the AI developer ecosystem and build examples with models, frameworks, tools, and platforms relevant to LiteLLM users.
  • Use developer feedback and adoption data to prioritize educational resources, integrations, and community initiatives.
  • Represent LiteLLM through technical talks, workshops, videos, podcasts, and conversations with the developer community.
  • Create educational resources around problems developers are actively trying to solve.
  • Explain LiteLLM capabilities including model routing, fallbacks, cost controls, observability, authentication, guardrails, MCP, and production deployment.
  • Keep examples and technical content accurate as LiteLLM and the wider AI ecosystem evolve.
  • Improve the path from learning about a capability to implementing it successfully.
  • Build relationships with developers using, evaluating, and contributing to LiteLLM.
  • Participate in GitHub discussions, community channels, technical forums, and open-source conversations.
  • Help developers get unstuck and identify patterns that should become durable resources or product improvements.
  • Support contributors and power users and create opportunities for them to share what they have built.
  • Build a structured feedback loop between the developer community and LiteLLM’s Product and Engineering teams.
  • Identify recurring confusion, missing integrations, documentation gaps, and product friction.
  • Reproduce technical issues and distinguish documentation, usability, and product problems.
  • Turn developer feedback into product recommendations, issues, examples, and documentation improvements.
  • Contribute technical fixes directly when appropriate and partner with Engineering on larger product changes.
  • Own developer-facing execution for major product and open-source launches.
  • Work with Product and Engineering to understand what is shipping, who it is for, and why it matters.
  • Produce demos, sample code, tutorials, documentation, and technical explanations to help developers try new capabilities.
  • Ensure launches demonstrate working implementations and evaluate whether they lead to meaningful developer understanding and adoption.
  • Establish LiteLLM’s initial Developer Relations priorities and operating rhythm.
  • Determine where technical content, integrations, community engagement, and events can have the greatest impact.
  • Define practical measures of success based on developer adoption, successful implementations, community participation, and product learning.
  • Build repeatable systems for turning product releases and developer questions into useful technical resources.
  • Help define how the Developer Relations function should evolve as LiteLLM grows.
  • Become a hands-on LiteLLM user and develop a deep understanding of its product, codebase, documentation, and community.
  • Build production-quality example applications covering important LiteLLM use cases.
  • Audit the developer journey from initial discovery through successful production deployment.
  • Identify high-impact gaps in documentation, examples, onboarding, and technical storytelling.
  • Meet developers, contributors, customers, and internal teams to understand LiteLLM usage and points of difficulty.
  • Establish a repeatable process for supporting developer-facing product launches.
  • Ship initial tutorials, demos, or integrations based on identified needs.
  • Create a system for turning recurring community questions into documentation, examples, or product feedback.
  • Propose a focused Developer Relations roadmap for the following six months.
Desired Qualifications
  • Experience with developer infrastructure, APIs, observability, security, cloud platforms, or open-source software.
  • Familiarity with LLM application architecture and the challenges of operating AI systems in production.
  • Experience with AI model providers, gateways, agent frameworks, MCP, Kubernetes, or enterprise AI platforms.
  • Meaningful contributions to an open-source project.
  • Experience building a technical audience through writing, videos, workshops, talks, or community participation.
  • Experience establishing Developer Relations at an early-stage company.
  • Experience working with platform engineers, infrastructure teams, or enterprise developers.
  • A body of technical work to demonstrate, such as applications, tutorials, talks, videos, documentation, or open-source contributions.

About the company

LiteLLM provides an open-source LLM gateway and Python SDK that connects to 100+ LLM APIs and standardizes responses in an OpenAI-compatible format, acting as a translator across AI schemas to reduce vendor lock-in. Built on Python and FastAPI, it offers routing features like load balancing, automatic fallbacks, and regional prioritization, plus a centralized dashboard for cost and token usage. The platform emphasizes enterprise control with observability integrations (Prometheus, Langfuse, Sentry) and an open-core model where advanced features such as SSO, RBAC, and team budgets are available in a paid Enterprise Edition. Its target customers are large organizations and fast-growing companies in regulated industries needing data residency and strict operational governance.

Company Size

11-50

Company Stage

Seed

Total Funding

$630K

Headquarters

San Francisco, California

Founded

2023

Get referred to LiteLLM

See people who can refer or advise you

Simplify Jobs

Simplify's Take

What believers are saying

  • LiteLLM still reports massive developer adoption and active maintenance in 2026.
  • CrowdStrike partnership validates enterprise demand for secure AI traffic control at the gateway.
  • New CI/CD v2, rotated credentials, and recertification efforts reduce near-term operational fallout.

What critics are saying

  • March 24, 2026 PyPI compromise exposed credentials and triggered emergency release controls.
  • April 2026 Texas litigation named BerriAI over supply-chain security and compliance claims.
  • Open-source gateway commoditization and security scrutiny can push enterprises to Portkey or Kong.

What makes LiteLLM unique

  • LiteLLM unifies 140-plus model APIs behind one OpenAI-compatible interface in 2026.
  • Its open-source proxy and Python SDK sit inside many agent frameworks.
  • CrowdStrike added LiteLLM to its June 2026 Open Gateway Ecosystem.

Help us improve and share your feedback! Did you find this helpful?

Benefits

  • Health Insurance
  • Dental Insurance
  • Vision Insurance
  • 401(k) Company Match

Growth & Insights and Company News

Headcount

6 month growth

-4%

1 year growth

57%

2 year growth

-18%
Founderland
Aug 6th, 2026
LiteLLM raises $1.6M seed funding amid security challenges, hits $7M ARR

BerriAI, the San Francisco startup behind LiteLLM, has raised $1.6 million in seed funding from Y Combinator, Gravity Fund, and Pioneer Fund. The company builds an open-source gateway connecting developers to over 100 large language model APIs, handling routing, fallbacks, and rate limiting across providers like OpenAI and Anthropic. LiteLLM has accumulated more than 50,000 GitHub stars and routes hundreds of millions of API calls daily. BerriAI reports $7 million in annual recurring revenue, with customers including NASA, Adobe, Netflix, Stripe, and Nvidia. However, the company faced significant security challenges in March when a supply chain attack compromised its PyPI releases. Additional vulnerabilities emerged between spring and summer, leading to litigation filed in April 2026 in Texas federal court. Despite these setbacks, BerriAI recently open-sourced its Agent Platform and joined CrowdStrike's Open Gateway Ecosystem, continuing to compete with rivals like Portkey and Helicone in the AI gateway market.

PR Newswire
Apr 23rd, 2026
Akto partners with Langchain, Portkey, and LiteLLM to embed AI agent security across enterprise infrastructure

Akto, an AI agent security platform, has announced partnerships with Langchain, Portkey, TrueFoundry, Arcade, and LiteLLM to provide real-time defence against prompt injection, uncontrolled tool access and data leakage in AI agent deployments. The integrations embed Akto's runtime guardrails and observability directly into AI infrastructure platforms that enterprises already use, requiring no additional implementation work. This addresses a critical gap, as 79% of enterprises reportedly have limited visibility into AI agent runtime execution. The partnerships enable automated protection across the AI agent stack, from gateways and runtimes to frameworks and deployment platforms. Akto's technology inspects tool calls and responses in real-time, blocking injections, redacting sensitive data and enforcing policies before agents perform actions. The company raised $295 million across three funding rounds.

The Register
Mar 30th, 2026
Telnyx compromised in TeamPCP's second PyPI supply-chain attack after Trivy breach

A cybercrime group linked to the Trivy supply-chain attack has compromised Telnyx's Python SDK on PyPI, planting credential-stealing malware on developers' systems. Security firm Ox Security identified the attackers as TeamPCP, the same crew behind recent malicious LiteLLM packages. The compromised Telnyx versions (4.87.1 and 4.87.2) downloaded malware disguised as a .wav file that was decoded and executed on target machines. Telnyx, which sees over 34,000 weekly PyPI downloads, confirmed only its Python package was affected and has resolved the issue. The company recommends treating any environment running the affected versions as compromised and rotating exposed credentials. None of Telnyx's infrastructure, networking or other services were impacted.

PR Newswire
Mar 26th, 2026
Point Wild releases free vulnerability scanner within 24 hours of LiteLLM supply chain attack

Point Wild has released a free security tool, who-touched-my-packages, within 24 hours of a supply chain attack on the LiteLLM Python package. The attack, affecting a package with three million daily downloads, enabled exfiltration of SSH keys, cloud credentials and API tokens, with approximately 500,000 credentials already confirmed stolen. The scanner uses behavioural analysis and AI-powered classification to detect zero-day supply chain attacks, including credential harvesting, data exfiltration and obfuscated code. Unlike traditional security tools that rely on known vulnerability databases, it identifies malicious behaviour in real time through dependency graphing, local CVE cross-referencing and active behavioural scanning powered by agentic AI. The tool is available immediately via API, CLI command or GitHub integration. Point Wild released it for free to support the developer community amid heightened software supply chain concerns.

TechCrunch
Sep 28th, 2023
Chatgpt: Everything You Need To Know About The Ai-Powered Chatbot

ChatGPT, OpenAI’s text-generating AI chatbot, has taken the world by storm. It’s able to write essays, code and more given short text prompts, hyper-charging productivity. But it also has a more…nefarious side.In any case, AI tools are not going away — and indeed has expanded dramatically since its launch just a few months ago. Major brands are experimenting with it, using the AI to generate ad and marketing copy, for example.And OpenAI is heavily investing in it. ChatGPT was recently super-charged by GPT-4, the latest language-writing model from OpenAI’s labs. Paying ChatGPT users have access to GPT-4, which can write more naturally and fluently than the model that previously powered ChatGPT