Issues

• [RFC]: vLLM-Omni Large Scale Serving

  JiusiServe/vllm#205 · Filter by author fake0fan opened on Apr 1, 2026

• [Bug][长稳]: 数据系统长稳测试，跨机1E1P1D，使用Qwen2.5-VL-7B-Instruct模型，开启前缀缓存，拉起实例成功，持续24h发送请求，4h后请求报错300s超时Request xxx timed out after 300s without worker response

  bugCriticalhigh priorityMajornew feature bug
  Bug

  JiusiServe/vllm#203 · Filter by author zhumingjue138 opened on Jan 12, 2026 · EPD-main (1130)

• [Bug][功能]: 数据系统场景下，开启redis发现服务，使用Qwen2.5-VL-7B-Instruct模型，用ipv6，拉起1proxy1e1p1d实例，proxy、worker单机，开启前缀缓存，拉起实例成功，持续发送请求，扩容D实例，proxy识别到D实例，新增D实例报错

  bughigh priorityMajornew feature bug
  Bug

  JiusiServe/vllm#202 · Filter by author zhumingjue138 opened on Jan 12, 2026 · EPD-main (1130)

• [Bug][功能]: 不使用redis发现服务，使用Qwen2.5-VL-7B-Instruct模型，用ipv6，拉起1proxy1e1p1d实例，proxy、worker单机，开启前缀缓存，拉起实例成功，持续发送请求，先扩缩容p实例，再扩缩容d实例，缩容d完成后报错AssertionError: Encoder cache miss forxxx ,初始P实例异常死亡

  bughigh priorityMajornew feature bug
  Bug

  JiusiServe/vllm#180 · Filter by author wangwei1254 opened on Dec 10, 2025 · EPD-main (1130)
  3

  

• [Feature]: Encoder does not load language model weights

  stale
  JiusiServe/vllm#173 · Filter by author amy-why-3459 opened on Dec 5, 2025
  1

• [Feature]: Support for start_profile and stop_profile interfaces

  stale
  JiusiServe/vllm#162 · Filter by author amy-why-3459 opened on Nov 27, 2025
  1

• [Feature]: Check_Health Heartbeat Optimization

  stale
  JiusiServe/vllm#161 · Filter by author amy-why-3459 opened on Nov 27, 2025 · EPD-main (1215)
  2

  

• [Feature]: Mooncake Store PD Separation Supports MLA Model

  stale
  JiusiServe/vllm#160 · Filter by author amy-why-3459 opened on Nov 27, 2025
  1

  

• [Feature]: Supports asynchronous transmission of EncoderCache

  JiusiServe/vllm#155 · Filter by author amy-why-3459 opened on Nov 23, 2025 · EPD-main (1215)
  2

  

• [Performance]: Performance Verification and Comparison

  stale
  JiusiServe/vllm#149 · Filter by author amy-why-3459 opened on Nov 19, 2025 · EPD-main (1130)
  2

  

• [Performance]: Qps estimation

  stale
  JiusiServe/vllm#144 · Filter by author Bounty-hunter opened on Nov 17, 2025
  1

• [RFC]: End-to-end deployment verification

  stale
  JiusiServe/vllm#139 · Filter by author amy-why-3459 opened on Nov 13, 2025
  1

  

• [Feature][EPDDisagg] Support Service Discovery based on external metadata store

  stale
  JiusiServe/vllm#124 · Filter by author wuhang2014 opened on Nov 5, 2025 · EPD-main (1130)
  2

  

• [Bug][性能]: Tarsier-34b模型1E2PD， LatestInFlightRouter相比RandomRouter策略未见性能提升

  buglow priorityMinor
  JiusiServe/vllm#105 · Filter by author yenuo26 opened on Oct 28, 2025 · EPD-main (1115)
  1

  

• [Feature]: Synchronous API supporting health_check to obtain instance status in a timely manner

  low prioritystale
  JiusiServe/vllm#98 · Filter by author amy-why-3459 opened on Oct 23, 2025
  1

  

• [RPC]: Instance Scaling

  stale
  JiusiServe/vllm#84 · Filter by author amy-why-3459 opened on Oct 17, 2025 · EPD-main (1130)
  1

  

• [RFC]: Transfer metadata from the E instance to the pd instance via a proxy or zmq

  stale
  JiusiServe/vllm#72 · Filter by author amy-why-3459 opened on Oct 13, 2025
  1

  

• [RFC]: Attention-FFN Disaggregation

  high prioritystale
  JiusiServe/vllm#43 · Filter by author hsliuustc0106 opened on Sep 26, 2025
  1

• [RFC]: Encoder-Prefill-Decode Disaggregation for Multi-modal Models Serving in vLLM

  enhancementhigh priority
  JiusiServe/vllm#18 · Filter by author hsliuustc0106 opened on Sep 17, 2025