Pinned Loading

1. InferMatrixLab/system1-omni InferMatrixLab/system1-omni Public

   community maintained vllm/vllm-omni style inference engine for system1 models in Rust for extreme efficient performance

   Python 63 17

2. douyin-ai-leadgen douyin-ai-leadgen Public

   Python 12 4

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 96.1k 24.3k

4. vllm-project/vllm-omni vllm-project/vllm-omni Public

   A framework for efficient model inference with omni-modality models

   Python 7.5k 2k

5. ByteDance-Seed/VeOmni ByteDance-Seed/VeOmni Public

   VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo

   Python 2.3k 310

6. deepspeedai/DeepSpeed deepspeedai/DeepSpeed Public

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 43.3k 5.1k