Overview

Inferact builds AI inference infrastructure by maintaining vLLM, an open-source LLM inference engine, and offering a managed enterprise inference service. vLLM uses PagedAttention to optimize GPU memory, cutting inference costs and latency while preserving model quality. The company supports multiple architectures and hardware, aligns with PyTorch Foundation governance, and pursues open-source collaboration alongside a commercial platform. Its goal is to turn AI inference into a reliable, scalable operating layer of the AI stack, separating model deployment from application development.

Launched Recently

Significant Headcount Growth