feat(KV-FP8): W3 -- half-sized KV blocks the runner actually serves, and a default scale that knows it was declared (#1593) - #1641

Merged

localai-bot merged 17 commits into

mainfrom

Aug 23, 2026

Commits on Aug 21, 2026

feat(KV-FP8): the CUDA fp8 KV store and read, reached by removing the W1 guard that refused CUDA before the provider table (#1593)
mudler
committed
4d71e77
fix(KV-FP8): the W2 anchors point at an identity template, and G5 could not fail for any CUDA defect (#1593, #1636)
mudler
committed
3e9c771
feat(KV-FP8): W3 -- half-sized KV blocks the runner actually serves, and a default scale that knows it was declared (#1593)
mudler
committed
68d2e0d

Commits on Aug 22, 2026

Commits on Aug 23, 2026