feat(MODEL-MM-QWEN4-EXP): W4 — Qwen Sparse Attention with a GATHER consumer, counted at the key-row read - #2030

Merged

localai-bot merged 6 commits into

mainfrom

row/MODEL-MM-QWEN4-EXP-W4

Aug 27, 2026

Commits on Aug 26, 2026

feat(MODEL-MM-QWEN4-EXP): W4 — Qwen Sparse Attention with a GATHER consumer, so the long-context lever survives the port (#1991)
mudler
committed
e1476d1
fix(MODEL-MM-QWEN4-EXP): W4 — the gather's counter now measures the loop, not its index buffer
mudler
committed
b0802fb
Merge origin/main into row/MODEL-MM-QWEN4-EXP-W4
mudler
committed
c8a6fc4

Commits on Aug 27, 2026

merge: origin/main into row/MODEL-MM-QWEN4-EXP-W4
mudler
committed
ab9a58d
merge: origin/main into row/MODEL-MM-QWEN4-EXP-W4 (second pass)
mudler
committed
623e288
merge: origin/main into row/MODEL-MM-QWEN4-EXP-W4 (third pass)
mudler
committed
15d913d