Repository navigation

feat(kvcache): host-resident prefix tier for hybrid GDN models (snapshots + KV pages) - #525

Closed

alvarorsouza-arch wants to merge 3 commits into

FlashML-org:mainfrom

alvarorsouza-arch:host-prefix-tier

Closed

feat(kvcache): host-resident prefix tier for hybrid GDN models (snapshots + KV pages)#525
alvarorsouza-arch wants to merge 3 commits into
FlashML-org:mainfrom
alvarorsouza-arch:host-prefix-tier

Commits on Sep 17, 2026
- feat(kvcache): host-RAM KV tier for sparse-attention models (--kv-host-pages)
  alvarorsouza-arch
  committed
  849e072
Commits on Sep 19, 2026
- fix(kvcache): fp8-aware write-through mirror + batch-safe selection cap
  alvarorsouza-arch
  committed
  20f3b23
- feat(kvcache): host-resident prefix tier for hybrid GDN models
  alvarorsouza-arch
  committed
  5046e4a