Repository navigation

feat(qwen4exp): 262K context for four requests in split mode, KV of some layers on the Strix - #833

Merged

davide221 merged 2 commits into

mainfrom

feat/qwen4exp-kv-offload

Oct 9, 2026

Merged

feat(qwen4exp): 262K context for four requests in split mode, KV of some layers on the Strix#833
davide221 merged 2 commits into
mainfrom
feat/qwen4exp-kv-offload

Commits on Oct 9, 2026
- fix(ggml-cuda): copy a tensor between two devices on the source's stream
  
  mrciffa
  and
  claude
  committed
  abe19e9
- feat(qwen4exp): split serving keeps attention layers' KV on the Strix when the R9700 is full
  
  mrciffa
  and
  claude
  committed
  cb6116c