Is there a FastTokenizer implementation for ESM models?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Fast tokenizer for marianMTModel | 1 | 518 | September 26, 2022 | |
BertTokenizerFast for stsb-xlm-r-multilingual model | 3 | 662 | April 8, 2021 | |
Introducing FlashTokenizer: The World's Fastest Tokenizer Library for LLM Inference | 2 | 38 | March 21, 2025 | |
🚀 Introducing FlashTokenizer: The World's Fastest CPU Tokenizer! | 2 | 43 | April 4, 2025 | |
FastTokenizer add 10 more tokens in Avg | 0 | 200 | January 20, 2024 |