Skip to content

feat(KV-FP8): W3 -- half-sized KV blocks the runner actually serves, and a default scale that knows it was declared (#1593) - #1641

Merged
localai-bot merged 17 commits into
mainfrom
row/KV-FP8-W3
Aug 23, 2026
Merged

feat(KV-FP8): W3 -- half-sized KV blocks the runner actually serves, and a default scale that knows it was declared (#1593)#1641
localai-bot merged 17 commits into
mainfrom
row/KV-FP8-W3

docs(KV-FP8): a `1e-4` tolerance would have CAUGHT the K-side read mu…

3c22151
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar