Pinned Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

2. vllm-omni vllm-omni Public

   Forked from vllm-project/vllm-omni

   A framework for efficient model inference with omni-modality models

   Python

3. Sana Sana Public

   Forked from NVlabs/Sana

   SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer

   Python

4. ai-dynamo/aisimulate ai-dynamo/aisimulate Public

   AISimulate predicts LLM serving behavior and searches for strong deployment configurations offline, without bringing up a GPU serving cluster

   Python 105 48

5. pi pi Public

   Forked from earendil-works/pi

   AI agent toolkit: coding agent CLI, unified LLM API, TUI & web UI libraries, Slack bot, vLLM pods

   TypeScript

6. mini-sglang mini-sglang Public

   Forked from sgl-project/mini-sglang

   A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

   Python