I have created a token classification model, and I was thinking during inference is it better to remove special tokens on encoding or the prediction will be affected by this change !
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| My BERT won’t predict any special tokens | 0 | 57 | June 20, 2024 | |
| Different sentiments when texts processed in batches vs singles | 1 | 442 | July 3, 2022 | |
| BertForTokenClassification Classifying [PAD] tokens | 0 | 280 | August 13, 2021 | |
| Model gives output even for SEP token | 0 | 469 | February 1, 2023 | |
| Word Specific Classification (custom token classification?) | 0 | 71 | May 28, 2024 |