Skip to content

5080deploy: merge upstream #578, NVFP4 prefill dequant by bit placement (-32% TTFT at 64K, bit-identical) - #79

Open
gdevenyi wants to merge 5 commits into
5080/35-1080deploy-fixesfrom
5080/36-nvfp4-prefill-578
Open

5080deploy: merge upstream #578, NVFP4 prefill dequant by bit placement (-32% TTFT at 64K, bit-identical)#79
gdevenyi wants to merge 5 commits into
5080/35-1080deploy-fixesfrom
5080/36-nvfp4-prefill-578

merge #578: perf(moe): dequant nvfp4 prefill experts by bit placement…

009fa6c
Select commit
Loading
Failed to load commit list.

There are no checks for this commit