Skip to content

cuda: fuse the Gemma 4 MoE layer tail (GGML_CUDA_TAIL_FUSION, off by default) - #414

Merged
bri-prism merged 4 commits into
prismfrom
gemma/tail-fusion
Oct 29, 2026
Merged

bri-prism merged 4 commits into
prismfrom
gemma/tail-fusion

cuda: fold the next attn_norm and its q8_1 quantize into the Gemma 4 …

ca231a6
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
Analyze (c-cpp)
succeeded Oct 28, 2026 in 12m 23s