Repository navigation

5080deploy: merge upstream #559, #531, #269, #468, #461, #484, #464, #266, #572 - #76

Open

gdevenyi wants to merge 25 commits into

5080/33-rebuild-d3512b4from

5080/34-upstream-prs

Open

5080deploy: merge upstream #559, #531, #269, #468, #461, #484, #464, #266, #572#76
gdevenyi wants to merge 25 commits into
5080/33-rebuild-d3512b4from
5080/34-upstream-prs

Commits on Aug 29, 2026
- fix(server): hide qwen transport markers from semantic responses
  HaileyStorm
  committed
  90be981
- fix(server): report why a tokenizer/detokenizer worker died during load
  sime2408
  committed
  f139235
Commits on Sep 13, 2026
- fix(server): loopback-bind the TP rendezvous store, add --dist-port
  shikhakath
  committed
  b482b86
Commits on Sep 14, 2026
- fix(scheduler): match stop strings with incremental decoding
  taking-lying-flat
  committed
  3882ef6
Commits on Sep 15, 2026
- feat(scheduler): interleave decode steps into long prefill runs
  xfgong
  committed
  6a47d2d
- test(scheduler): exercise the real _schedule_next_batch, not a model of it
  xfgong
  committed
  e96388f
Commits on Sep 20, 2026
- fix(server): clamp /v1/models context_length to the allocated KV pool
  
  oscar-investmatic
  and
  claude
  committed
  b9b8f1b
Commits on Sep 27, 2026
- fix(kvcache): clone inserted radix keys to release request buffers
  taking-lying-flat
  committed
  2f37ac5
Commits on Sep 28, 2026
- fix(engine): reject fa attention backend below sm_90 at config time
  SanjayS45
  committed
  c2091c6
- fix(engine): drop the tutorial comment on the fa sm_90 gate
  SanjayS45
  committed
  f29be24
Commits on Sep 29, 2026
- fix(server): keep a silent stream alive and notice a client that left
  YevheniiKotyrlo
  committed
  6e63b8f
Commits on Oct 1, 2026
- test(server): patch the keep-alive interval strictly
  YevheniiKotyrlo
  committed
  09ab44e
Commits on Oct 2, 2026

Navigation Menu

Repository navigation

5080deploy: merge upstream #559, #531, #269, #468, #461, #484, #464, #266, #572 - #76

5080deploy: merge upstream #559, #531, #269, #468, #461, #484, #464, #266, #572#76
gdevenyi wants to merge 25 commits into
5080/33-rebuild-d3512b4from
5080/34-upstream-prs

Commits on Aug 29, 2026

fix(server): hide qwen transport markers from semantic responses

fix(server): report why a tokenizer/detokenizer worker died during load

Commits on Sep 13, 2026

fix(server): loopback-bind the TP rendezvous store, add --dist-port

Commits on Sep 14, 2026

fix(scheduler): match stop strings with incremental decoding

Commits on Sep 15, 2026

feat(scheduler): interleave decode steps into long prefill runs

test(scheduler): exercise the real _schedule_next_batch, not a model of it

Commits on Sep 20, 2026

fix(server): clamp /v1/models context_length to the allocated KV pool

Commits on Sep 27, 2026

fix(kvcache): clone inserted radix keys to release request buffers

Commits on Sep 28, 2026

fix(engine): reject fa attention backend below sm_90 at config time

fix(engine): drop the tutorial comment on the fa sm_90 gate

Commits on Sep 29, 2026

fix(server): keep a silent stream alive and notice a client that left

Commits on Oct 1, 2026

test(server): patch the keep-alive interval strictly

Commits on Oct 2, 2026

merge #559: fix(kvcache): clone inserted radix keys to release request buffers

merge #531: fix(server): clamp /v1/models context_length to the allocated KV pool

merge #269: fix(server): report why a tokenizer/detokenizer worker died during load

merge #468: fix(engine): reject fa attention backend below sm_90 at config time

merge #461: fix(server): loopback-bind the TP rendezvous store, add --dist-port

fix(engine): hand the rendezvous listen fd to TCPStore instead of keeping its socket

merge #484: feat(scheduler): interleave decode steps into long prefill runs

merge #464: fix(scheduler): match stop strings with incremental decoding

fix(scheduler): trim the stop-match EOS only at the delivered output limit

test(tokenizer): cover a detokenize batch that carries one uid more than once

fix(scheduler): match stop strings in the text the request's skip_special_tokens decodes

merge #266: fix(server): hide qwen transport markers from semantic responses

merge #572: fix(server): keep a silent stream alive and notice a client that left