I fine-tuned the whisper-small checkpoint, but in inference I am getting this warning: ‘Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.’ I’m getting this warning after fine-tuning whisper. How can I avoid this error or how can I add special tokens so that I do not get this error?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Special tokens warning | 0 | 2201 | October 25, 2022 | |
| Fine-tuning whsiper on custom special tokens | 0 | 135 | February 16, 2025 | |
| Repeatedly decoding tokens multiple times after PEFT fine-tuning whisper | 2 | 772 | September 20, 2023 | |
| Process to adding new tokens to a corpus and subsequently training the corresponding word embeddings | 0 | 3774 | April 21, 2021 | |
| Whisper Message: Special tokens have been added in the vocabulary | 0 | 355 | March 28, 2024 |