Skip to content

perf(text): skip forbidden control-token scans for plain input - #187

Open
Afloat16 wants to merge 1 commit into
Edge0-AI:mainfrom
Afloat16:afloat/20261111-next-plain-tokenization-fastpath
Open

Afloat16 wants to merge 1 commit into
Edge0-AI:mainfrom
Afloat16:afloat/20261111-next-plain-tokenization-fastpath

perf(text): skip forbidden control-token scans for plain input

86e5837
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs