Skip to content

fix(SERVE-STREAM-USAGE): the chat role frame waits for the first engine result, so TTFT stops measuring an empty frame (#1982) - #1994

Merged
localai-bot merged 4 commits into
mainfrom
row/SERVE-CHAT-ROLE-FRAME-ORDER
Aug 27, 2026
Merged

fix(SERVE-STREAM-USAGE): the chat role frame waits for the first engine result, so TTFT stops measuring an empty frame (#1982)#1994
localai-bot merged 4 commits into
mainfrom
row/SERVE-CHAT-ROLE-FRAME-ORDER

test(SERVE-STREAM-USAGE): record why the #1999 state-budget clamp can…

0ee83eb
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar