L

LiteLLM

Open-source LLM gateway routing multiple providers

Forward Deployed Engineer New Grad

Customer SupportConfirmed live in the last 24 hours
Full-timeUnited StatesIn-person

About the Job

Requirements

  • A computer science degree from a top university is mandatory.
  • Strong technical fundamentals and the ability to learn the LiteLLM product surface quickly.
  • A customer-focused approach to helping customers succeed with the product.
  • The ability to investigate root causes rather than apply surface-level fixes.
  • A metrics-driven, hardworking approach and readiness to handle a high volume of tickets.
  • A strong bias toward understanding problems deeply.

Responsibilities

  • Own the support queue and work through tickets to drive customers to success.
  • Diagnose customer issues and solve for the root cause, not just the symptom.
  • Reproduce customer issues in their specific environments.
  • Submit pull requests for bug fixes and improvements where needed.
  • Act as the technical voice of the customer back to engineering.

About the Company

LiteLLM

Open-source LLM gateway routing multiple providers

LiteLLM provides an open-source gateway and Python SDK that connects to many LLM APIs through a single, OpenAI-compatible format. It acts as a universal translator for different AI schemas and enables swapping models with minimal code changes. Built on Python and FastAPI, it offers features like load balancing, automatic fallbacks, regional request prioritization, a cost/token dashboard, and observability integrations for monitoring latency and reliability. It uses a B2B open-core model, offering core routing and SDK for free while selling Enterprise features like SSO, RBAC, and team budgets to large, regulated organizations demanding data residency and strong operational control.

Company size
11-50
Company stage
Seed
Total funding
$630K
Headquarters
San Francisco, CA
Founded
2023

Recently Posted Jobs

Explore more opportunities at LiteLLM

See more jobs