You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Streaming /v1/messages: message_start reports input_tokens 0 and no cache fields #93
Streamed /v1/messages sends message_start with usage = {"input_tokens": 0, "output_tokens": 0} and no cache fields, also with --enable-cache-report. The real prompt and cache counts arrive only in the final message_delta. Clients that read input usage from message_start see 0 on every streamed turn.
Upstream: FlashML-org#718 (repro, cause and proposed fix). The repro there gives the same output on 5080deploy c23d2d5:
Activity
gdevenyi commentedon Oct 20, 2026
Fixed by 76f6f1e on 5080deploy (round 7, PR to follow in the round-7 rebuild PR); message_start now carries the admitted prompt usage.