L

LiteLLM

Open-source LLM gateway routing multiple providers

Senior Security Engineer - Product & Platform

Security Engineering & ArchitectureUpdated on Nov 17
Full-timeSan Francisco, CA, USA$220k - $285k /yr

About the Job

Requirements

  • At least 7 years of relevant experience, including independent ownership of a security scope.
  • Experience hardening a production continuous integration and continuous delivery (CI/CD) pipeline, including GitHub Actions permissions and keyless signing.
  • Strong knowledge of a major cloud provider, preferably Amazon Web Services (AWS), including identity and access management (IAM), secrets management, and workload identity.
  • Familiarity with Terraform.
  • Ability to read production Python web-service code, identify vulnerabilities, and implement fixes.
  • Experience building security tooling and guardrails adopted by engineering teams.
  • Strong judgment in prioritizing risk when several problems need attention at once.
  • Excellent written and verbal communication, including the ability to coordinate independently across time zones.

Responsibilities

  • Review and harden LiteLLM’s Python codebase, fixing vulnerabilities and addressing their underlying causes.
  • Review sensitive pull requests and architecture changes before they reach production.
  • Harden the build and release pipeline, including GitHub Actions permissions, workload identity, signing, and credential handling.
  • Build and maintain automated controls for secrets detection, credential management, and software release integrity.
  • Review cloud architecture, IAM, secrets management, and workload identity, and implement security improvements.
  • Build guardrails and secure defaults that fit how engineers work.
  • Document the security architecture, decisions, and operating practices.
  • Own delivery and ongoing maintenance of product and pipeline security improvements.

Desired Qualifications

  • Experience as the first or second security hire at a developer-tools or open-source company.
  • A background in software, platform, or infrastructure engineering.
  • Experience leading platform or infrastructure security, defining roadmaps, and owning the security of releases.

About the Company

LiteLLM

Open-source LLM gateway routing multiple providers

LiteLLM provides an open-source gateway and Python SDK that connects to many LLM APIs through a single, OpenAI-compatible format. It acts as a universal translator for different AI schemas and enables swapping models with minimal code changes. Built on Python and FastAPI, it offers features like load balancing, automatic fallbacks, regional request prioritization, a cost/token dashboard, and observability integrations for monitoring latency and reliability. It uses a B2B open-core model, offering core routing and SDK for free while selling Enterprise features like SSO, RBAC, and team budgets to large, regulated organizations demanding data residency and strong operational control.

Company size
11-50
Company stage
Seed
Total funding
$630K
Headquarters
San Francisco, CA
Founded
2023

Recently Posted Jobs

Explore more opportunities at LiteLLM

See more jobs