server: cancel resumable streams before first token - #27482

server: cancel resumable streams before first token#27482

NitayRabi wants to merge 1 commit into

ggml-org:masterggml-org/llama.cpp:masterfrom

NitayRabi:fix/router-stream-cancel-generationNitayRabi/llama.cpp:fix/router-stream-cancel-generationCopy head branch name to clipboard