Repository navigation

fix(server): each turn reuses the previous one, long prompts share time, late system messages work - #835

Merged

davide221 merged 9 commits into

mainfrom

feat/qwen4exp-turn-restore-points

Oct 11, 2026

Merged

fix(server): each turn reuses the previous one, long prompts share time, late system messages work#835
davide221 merged 9 commits into
mainfrom
feat/qwen4exp-turn-restore-points

Commits on Oct 10, 2026
- fix(server): the prefix cache keeps each turn's end, for every request at once
  
  mrciffa
  and
  claude
  committed
  8222fb1
- feat(server): requests decoding beside a long prompt keep half the time
  
  mrciffa
  and
  claude
  committed
  b31fc49
- fix(server): Claude Code requests no longer fail, replies start without blank lines
  
  mrciffa
  and
  claude
  committed
  569f4da
- feat(server): usage reports the prompt tokens the prefix cache served
  
  mrciffa
  and
  claude
  committed
  980e3f4
- fix(server): a late system message stays one where the template takes it
  
  mrciffa
  and
  claude
  committed
  de01afd
Commits on Oct 11, 2026
- fix(server): every model keeps each turn's end, and the turn before it for edits
  
  mrciffa
  and
  claude
  committed
  d70e30d
- fix(ggml-cuda): paged attention keeps its partials within 256 MiB
  
  mrciffa
  and
  claude
  committed
  a3836a8
- feat(qwen35): requests decoding beside a long prompt keep half the time
  
  mrciffa
  and
  claude
  committed
  c103960
- perf(qwen4exp): an agent's next step no longer gives up time to decoding requests
  
  mrciffa
  and
  claude
  committed
  aa2b7d2