Issues

• Clarification on the accuracy statement regarding FastBertTokenizer

  NLPOptimize/flash-tokenizer#11 · Filter by author georg-jung opened on Jul 22, 2026

• 这个仓库似乎没有LICENSE文件，README中也没有相关描述

  NLPOptimize/flash-tokenizer#10 · Filter by author dou059593 opened on Jun 3, 2026

• Incorrect result of Korean sample with character '고' in ARM64 architecture

  NLPOptimize/flash-tokenizer#9 · Filter by author vsantosu opened on Dec 11, 2025

• “张” value is error

  💢 Bug
  NLPOptimize/flash-tokenizer#7 · Filter by author yegeli opened on May 15, 2025
  2

• 如何在C++11进行调用

  🤲🏻 Feature request 🤲🏻
  NLPOptimize/flash-tokenizer#6 · Filter by author yourbikun opened on Apr 28, 2025
  1

• C#能调用吗？

  🤲🏻 Feature request 🤲🏻
  NLPOptimize/flash-tokenizer#5 · Filter by author dfengpo opened on Apr 24, 2025
  4

• question: does it work with PreTrainedTokenizerFast

  🤲🏻 Feature request 🤲🏻❔Question
  NLPOptimize/flash-tokenizer#4 · Filter by author geraldstanje opened on Apr 9, 2025
  10