Repository navigation

feat(qwen4exp): fit the context to the devices, prefix snapshots in system memory - #832

Merged

davide221 merged 3 commits into

mainfrom

feat/qwen4exp-context-auto

Oct 9, 2026

Merged

feat(qwen4exp): fit the context to the devices, prefix snapshots in system memory#832
davide221 merged 3 commits into
mainfrom
feat/qwen4exp-context-auto

Commits on Oct 9, 2026
- fix(qwen4exp): prefix snapshots in system memory beside a discrete GPU
  
  davide221
  and
  claude
  committed
  77c02f2
- feat(server): --max-ctx auto fits Qwen3.8-Flash-Next's context to the devices
  
  davide221
  and
  claude
  committed
  82397fd
- fix(qwen4exp): split serving keeps one prompt chunk's memory on the target
  
  davide221
  and
  claude
  committed
  b1fe6be