Repository navigation

feat(scheduler): --logprob-read-isolate makes logprob reads independent of other traffic - #96

Open

gdevenyi wants to merge 3 commits into

5080/47-rebuild-cc56b6bdfrom

5080/48-logprob-read-isolate

Open

feat(scheduler): --logprob-read-isolate makes logprob reads independent of other traffic#96
gdevenyi wants to merge 3 commits into
5080/47-rebuild-cc56b6bdfrom
5080/48-logprob-read-isolate

Commits on Oct 20, 2026
- feat(scheduler): add the --logprob-read-isolate flag and the is_logprob_read predicate
  
  gdevenyi
  and
  claude
  committed
  fc30523
- feat(scheduler): prefill an isolated logprob read in a pass of its own
  
  gdevenyi
  and
  claude
  committed
  fed0156
- feat(scheduler): keep isolated logprob reads out of the prefix cache
  
  gdevenyi
  and
  claude
  committed
  cc13fec