feat(MODEL-MM-QWEN4-EXP): W3 — the 4-branch gated-residual hyper-connection stream and its grouped RMSNorm - #2045

Merged

localai-bot merged 8 commits into

mainfrom

row/MODEL-MM-QWEN4-EXP-W3

Aug 27, 2026

Commits on Aug 26, 2026

feat(MODEL-MM-QWEN4-EXP): W3 — the gated-residual stream reads a GROUPED norm and writes a rank-1 update (#1988)
mudler
committed
a5bd413
fix(MODEL-MM-QWEN4-EXP): W3 — the gate could not see a NaN, eight deleted refusals, or the model's own width (#1988)
mudler
committed
09ce43f
fix(MODEL-MM-QWEN4-EXP): W3 — the GGUF fold guidance now cites the pinned llama.cpp, not a repudiated local commit
mudler
committed
23483db
merge: origin/main into row/MODEL-MM-QWEN4-EXP-W3
mudler
committed
3a4e8f5
merge: origin/main into row/MODEL-MM-QWEN4-EXP-W3 (second pass)
mudler
committed
9b75a2b
merge: origin/main into row/MODEL-MM-QWEN4-EXP-W3 (third pass)
mudler
committed
f794d92

Commits on Aug 27, 2026