Skip to content

ggml : speed up batch-1 CPU decode, align large allocations - #27478

Open
matevz-kovacic wants to merge 2 commits into
ggml-org:masterfrom
matevz-kovacic:batch1-decode-attn-align
Open

ggml : speed up batch-1 CPU decode, align large allocations#27478
matevz-kovacic wants to merge 2 commits into
ggml-org:masterfrom
matevz-kovacic:batch1-decode-attn-align