Is there a FastTokenizer implementation for ESM models?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| BertTokenizerFast for stsb-xlm-r-multilingual model | 3 | 660 | April 8, 2021 | |
| 🚀 Introducing FlashTokenizer: The World's Fastest CPU Tokenizer! | 2 | 9 | April 4, 2025 | |
| Introducing FlashTokenizer: The World's Fastest Tokenizer Library for LLM Inference | 2 | 21 | March 21, 2025 | |
| Introducing FlashTokenizer: The World’s Fastest Tokenizer Library for LLM Inference. I need more awesome optimized skills. Join | 2 | 18 | March 21, 2025 | |
| What is required to create a fast tokenizer? For example for a Marian model | 0 | 314 | March 16, 2023 |