Skip to content

5080deploy: OpenAI compat: stream/non-stream parser parity, chat logprobs under the parsers, logprobs/usage fixes, cache report + decode interleave - #92

Open
gdevenyi wants to merge 28 commits into
5080/42-rebuild-0bca88f7from
5080/43-openai-compat
Open

5080deploy: OpenAI compat: stream/non-stream parser parity, chat logprobs under the parsers, logprobs/usage fixes, cache report + decode interleave#92
gdevenyi wants to merge 28 commits into
5080/42-rebuild-0bca88f7from
5080/43-openai-compat

perf(server): collect non-streaming chat logprob entries only when asked

c23d2d5
Select commit
Loading
Failed to load commit list.

There are no checks for this commit