Gigatoken: A new open source tokenizer ~100x faster than Tiktoken, -500-1000x faster than Huggingface
英文标题：Gigatoken: A new open source tokenizer ~100x faster than Tiktoken, -500-1000x faster than Huggingface
submitted by /u/Thrumpwart [link] [comments]
打开原文相关 2 · 机会 2
中文
submitted by /u/Thrumpwart [link] [comments]
中文全文翻译正在补齐，可先查看下方英文原文。
English / 原文
submitted by /u/Thrumpwart [link] [comments]