Skip to content

fix: O(n log n) byte pair merge and one shared Tokenizer declaration - #15

Open
ThomasK33 wants to merge 10 commits into
mainfrom
fix/bpe-quadratic-and-typing
Open

ThomasK33 wants to merge 10 commits into
mainfrom
fix/bpe-quadratic-and-typing

ci: typecheck a claude_v5 tokenizer through the packed types

1125a60
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar