Skip to content

5080deploy 1/9: merge upstream #408, nvfp4 KV cache quantization - #9

Open
gdevenyi wants to merge 22 commits into
mainfrom
5080/01-nvfp4-kv-408
Open

5080deploy 1/9: merge upstream #408, nvfp4 KV cache quantization#9
gdevenyi wants to merge 22 commits into
mainfrom
5080/01-nvfp4-kv-408

test(kvcache): give the qsa fp8 pool fakes the mrope flag main now reads

a88f041
Select commit
Loading
Failed to load commit list.

There are no checks for this commit