I

Inferact

Open-source LLM inference engine with scalability

Member of Technical Staff - Vulnerability Management

Security Engineering & ArchitectureConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • Hands-on product security experience, with a strong orientation toward infrastructure software and the security of complex software systems.
  • Ability to read source code, debug unfamiliar systems, reproduce reported issues, and explain root cause and practical security impact rather than simply forward findings.
  • Strong systems reasoning, including the ability to understand architecture, trust boundaries, deployment assumptions, and how different software components interact.
  • Ability to learn vLLM's core architecture and independently manage vulnerability investigations while bringing in maintainers where their expertise is needed.
  • Sound prioritization and risk-assessment judgment, with clear documentation of evidence, affected behavior, remediation needs, and next steps.
  • Strong written and verbal communication, discretion with sensitive reports, and the ability to work constructively with engineers, researchers, and external security collaborators.

Responsibilities

  • Own Inferact's side of vLLM's vulnerability-management process and help keep a critical piece of AI infrastructure secure and production-grade.
  • Develop a deep understanding of vLLM's architecture, independently investigate vulnerability reports, and turn technical findings into clear, actionable work for the core team.
  • Collaborate with vLLM maintainers, Red Hat counterparts, security firms, and researchers working with frontier AI models.
  • Drive reports from initial triage through analysis and resolution, helping coordinate fixes, security advisories, and releases under the project's established process.
  • Identify practical security best practices that strengthen vLLM as it evolves.

Desired Qualifications

  • Experience with vulnerability management and security best practices for open-source infrastructure software.
  • Experience coordinating vulnerability resolution across reporters, maintainers, security teams, and software releases.
  • Familiarity with vLLM, inference engines, ML infrastructure, or similarly complex distributed software; prior vLLM contributions are helpful but not required.
  • Experience preparing security advisories, assessing affected versions, and working with CVE and coordinated-disclosure workflows.
  • Experience translating security findings into practical architecture reviews, regression tests, secure development practices, or deployment guidance.
  • Helped resolve vulnerabilities in an open-source infrastructure project and can explain the technical contribution and coordination with maintainers.
  • Built security tooling or automation that improved investigation quality or reduced repetitive triage work.
  • Turned recurring vulnerability patterns into maintainable fixes, tests, or documentation that helped prevent similar issues.

About the Company

Inferact

Open-source LLM inference engine with scalability

Inferact builds AI inference infrastructure centered on vLLM, an open-source large language model inference engine. It offers a managed inference service for enterprises with serverless deployment, observability, troubleshooting, disaster recovery, and multi-tenant Kubernetes scaling. vLLM uses PagedAttention to optimize GPU memory, lowering costs and latency while preserving model quality, and Inferact supports new architectures and hardware under vendor-neutral governance with PyTorch Foundation. The goal is to commoditize AI inference and deliver a production-ready operating layer for the AI stack.

Company size
11-50
Company stage
Seed
Total funding
$150M
Headquarters
San Francisco, CA
Founded
2025

Recently Posted Jobs

Explore more opportunities at Inferact

See more jobs