Skip to content

perf(text): skip forbidden control-token scans for plain input - #187

Open
Afloat16 wants to merge 1 commit into
Edge0-AI:mainfrom
Afloat16:afloat/20261111-next-plain-tokenization-fastpath
Open

perf(text): skip forbidden control-token scans for plain input#187
Afloat16 wants to merge 1 commit into
Edge0-AI:mainfrom
Afloat16:afloat/20261111-next-plain-tokenization-fastpath

Commits

  1. Commits on Nov 11, 2026