Repository navigation

5080deploy: merge upstream #578, NVFP4 prefill dequant by bit placement (-32% TTFT at 64K, bit-identical) - #79

Open

gdevenyi wants to merge 5 commits into

5080/35-1080deploy-fixesfrom

5080/36-nvfp4-prefill-578

Open

5080deploy: merge upstream #578, NVFP4 prefill dequant by bit placement (-32% TTFT at 64K, bit-identical)#79
gdevenyi wants to merge 5 commits into
5080/35-1080deploy-fixesfrom
5080/36-nvfp4-prefill-578

Commits on Sep 30, 2026
Commits on Oct 2, 2026
- merge #578: perf(moe): dequant nvfp4 prefill experts by bit placement and load activations contiguously
  gdevenyi
  committed
  009fa6c