Repository navigation

Batch sparse decode reference work without changing scalar reductions (follow-up to #157) - #158

Closed

0z5a wants to merge 8 commits into

InferMatrixLab:mainfrom

0z5a:codex/pr157-batched-attention

Closed

Batch sparse decode reference work without changing scalar reductions (follow-up to #157)#158
0z5a wants to merge 8 commits into
InferMatrixLab:mainfrom
0z5a:codex/pr157-batched-attention

Commits on Oct 27, 2026
- sparse decode attention: per-token reference lifecycle for async self-speculation
  kunkunblueberry
  committed
  e2f9f73
Commits on Oct 28, 2026