Is there a FastTokenizer implementation for ESM models?
Related Topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| BertTokenizerFast for stsb-xlm-r-multilingual model | 3 | 649 | April 8, 2021 | |
| What is required to create a fast tokenizer? For example for a Marian model | 0 | 307 | March 16, 2023 | |
| Fast tokenizer for marianMTModel | 1 | 492 | September 26, 2022 | |
| SentencePiece user_defined_symbols and fast tokenizers | 1 | 1395 | January 3, 2024 | |
| How to convert Tokenizer to TokenizerFast? | 1 | 520 | September 30, 2020 |