Skip to content

Respect the special flag on HF added tokens - #219

Open
u7k4rs6 wants to merge 1 commit into
meta-pytorch:mainfrom
u7k4rs6:fix-nonspecial-added-tokens
Open

u7k4rs6 wants to merge 1 commit into
meta-pytorch:mainfrom
u7k4rs6:fix-nonspecial-added-tokens

Respect special flag on HF added tokens

fd67fee
Select commit
Loading
Failed to load commit list.