Is there a FastTokenizer implementation for ESM models?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| BertTokenizerFast for stsb-xlm-r-multilingual model | 3 | 651 | April 8, 2021 | |
| What is required to create a fast tokenizer? For example for a Marian model | 0 | 307 | March 16, 2023 | |
| Fast tokenizer for marianMTModel | 1 | 497 | September 26, 2022 | |
| SentencePiece user_defined_symbols and fast tokenizers | 1 | 1430 | January 3, 2024 | |
| How to convert Tokenizer to TokenizerFast? | 1 | 525 | September 30, 2020 |