Repository navigation

feat(serving): replicated dynamo.vllm behind the Dynamo frontend + LiveKit 2xTP4 arm / 多副本 dynamo.vllm 与 LiveKit 2xTP4 配置 - #38

Open

DinhKhangHoang wants to merge 8 commits into

vng-benchmarkfrom

feat/serving-dynamo-vllm-replicas

Open

feat(serving): replicated dynamo.vllm behind the Dynamo frontend + LiveKit 2xTP4 arm / 多副本 dynamo.vllm 与 LiveKit 2xTP4 配置#38
DinhKhangHoang wants to merge 8 commits into
vng-benchmarkfrom
feat/serving-dynamo-vllm-replicas

Commits on Oct 21, 2026
- feat(serving): replicated dynamo.vllm engines behind the Dynamo frontend
  
  DinhKhangHoang
  and
  claude
  committed
  89bc223
- feat(serving): gemma4 livekit dyn arm on the thought-strip runtime
  
  DinhKhangHoang
  and
  claude
  committed
  d7dd177
- feat(serving): livekit_ttft.py splits LiveKit TTFT by first vs later turn
  
  DinhKhangHoang
  and
  claude
  committed
  611e7d5
- docs(serving): livekit_ttft.py in the zh procedures and the serving-bench skill
  
  DinhKhangHoang
  and
  claude
  committed
  de68e67
- docs(serving): results section matches what a run uploads
  
  DinhKhangHoang
  and
  claude
  committed
  424df27
- feat(serving): LiveKit dial warm-up + chunk arm on the Dynamo KV router
  
  DinhKhangHoang
  and
  claude
  committed
  4e6a455
- feat(serving): host_cpus / host_mem_gb override the hardware-hcm allocation
  
  DinhKhangHoang
  and
  claude
  committed
  3d0e5ec
- style: ruff format infx and match the hcm-rtx6000pro runner messages
  
  DinhKhangHoang
  and
  claude
  committed
  a4ee51b