Repository navigation

5080deploy: OpenAI compat: stream/non-stream parser parity, chat logprobs under the parsers, logprobs/usage fixes, cache report + decode interleave - #92

Open

gdevenyi wants to merge 28 commits into

5080/42-rebuild-0bca88f7from

5080/43-openai-compat

Open

5080deploy: OpenAI compat: stream/non-stream parser parity, chat logprobs under the parsers, logprobs/usage fixes, cache report + decode interleave#92
gdevenyi wants to merge 28 commits into
5080/42-rebuild-0bca88f7from
5080/43-openai-compat

Commits on Oct 15, 2026
- perf(sample): build the logprobs row index on the host
  
  gdevenyi
  and
  claude
  committed
  1cfa84e
- fix(responses): report the real reasoning_tokens in usage
  
  gdevenyi
  and
  claude
  committed
  113d269
- fix(tokenizer): report a logprob token's own bytes, not its decoded text
  
  gdevenyi
  and
  claude
  committed
  e533114
- fix(server): compute completions text_offset from the visible text
  
  gdevenyi
  and
  claude
  committed
  f1cede1
- fix(server): keep completions stream logprobs for acks with no text
  
  gdevenyi
  and
  claude
  committed
  aba56b6
- fix(tokenizer): count reasoning tokens when generation stops inside the block
  
  gdevenyi
  and
  claude
  committed
  9823a5b
- fix(server): send logprobs null on non-stream chat choices
  
  gdevenyi
  and
  claude
  committed
  866e56e
- fix(server): make the qwen3 reasoning split identical in streaming and one-shot
  
  gdevenyi
  and
  claude
  committed
  362719c
- fix(server): keep qwen3_coder text between tool calls in non-streaming responses
  
  gdevenyi
  and
  claude
  committed
  7339156
- fix(server): parse a bare qwen3_coder <function=...> call in streaming too
  
  gdevenyi
  and
  claude
  committed
  fdf372c
- fix(server): stamp completions text_offset in the detokenizer
  
  gdevenyi
  and
  claude
  committed
  e346c79
- docs(tokenizer): note that a raw prompt's literal <think> sets starts_in_reasoning
  
  gdevenyi
  and
  claude
  committed
  3a7073e
- fix(server): do not clip streamed text_offset before the finish chunk
  
  gdevenyi
  and
  claude
  committed
  022db45
- fix(server): keep post-call whitespace before a tag in qwen3_coder streams
  
  gdevenyi
  and
  claude
  committed
  3c23dd5
- fix(server): stop a qwen3_coder function name at the next tag
  
  gdevenyi
  and
  claude
  committed
  c6eae81
- fix(server): keep a qwen3_coder <tool_call> named in prose as content
  
  gdevenyi
  and
  claude
  committed
  b8572e9
- fix(server): drop a stray </tool_call> after a bare qwen3_coder call
  
  gdevenyi
  and
  claude
  committed
  7034101
- test(server): say why the leaked <|im_start|> follows the think block
  
  gdevenyi
  and
  claude
  committed
  c135eb0
- fix(server): treat a repeated qwen3_coder <tool_call> opener as one block
  
  gdevenyi
  and
  claude
  committed
  f7c463b
- fix(tokenizer): drop logprob entries of tokens a stop string trimmed
  
  gdevenyi
  and
  claude
  committed
  70a0222
- feat(server): serve chat logprobs under the qwen3 and qwen3_coder parsers
  
  gdevenyi
  and
  claude
  committed
  616717b
- merge fork: logprobs and usage fixes (token bytes, completions offsets and stream entries, host-built logprob row index, responses and truncated reasoning_tokens, logprobs null)
  gdevenyi
  committed
  33ee00e
- fix(server): align text after a bare call closer to the end of its token
  
  gdevenyi
  and
  claude
  committed
  b1f4f6b
- fix(server): strip leading content whitespace before the logprob shadow parse
  
  gdevenyi
  and
  claude
  committed
  9da69be
- fix(server): segment a stop-cut token's logprob entry on its visible text
  
  gdevenyi
  and
  claude
  committed
  973faa6
- merge fork: chat logprobs under the qwen3 and qwen3_coder parsers, and stream/non-stream parser consistency
  
  gdevenyi
  and
  claude
  committed
  1542d52
- perf(tokenizer): skip the logprob hold bookkeeping when nothing is held
  
  gdevenyi
  and
  claude
  committed
  8620928
- perf(server): collect non-streaming chat logprob entries only when asked
  
  gdevenyi
  and
  claude
  committed
  c23d2d5

Commits

Commits on Oct 15, 2026