Skip to content

5080deploy: rebuild on upstream main 0bca88f7 (#689 slot pools; identical decode, VRAM and greedy output) - #91

Open
gdevenyi wants to merge 136 commits into
5080/base-8eb353b3from
5080/42-rebuild-0bca88f7
Open

5080deploy: rebuild on upstream main 0bca88f7 (#689 slot pools; identical decode, VRAM and greedy output)#91
gdevenyi wants to merge 136 commits into
5080/base-8eb353b3from
5080/42-rebuild-0bca88f7

fix(server): accept top_k <= 0 as "disabled", as vLLM and the OpenAI-…

d5907fc
Select commit
Loading
Failed to load commit list.

There are no checks for this commit