I was trying to use the new whisper-large-v3 model and get the following error: File “/ext3/miniconda3/lib/python3.10/site-packages/transformers/tokenization_utils_base.py”, line 2065, in _from_pretrained raise ValueError( ValueError: Non-consecutive added token ‘<|0.02|>’ found. Should have inde…

Problem with whisper-large-v3

picheny November 8, 2023, 2:41pm 5

Actually, it just fixed it for me…thanks!

Topic		Replies	Views
Non-consecutive added token '<s>' found 🤗Transformers	0	1765	February 3, 2022
Whisper Message: Special tokens have been added in the vocabulary 🤗Transformers	0	354	March 28, 2024
Whisper fine tuning 🤗Transformers	0	433	January 18, 2024
Fine tuning whisper for ASR Beginners	0	447	July 13, 2023
Whisper Inference RuntimeError: The expanded size of the tensor (3000) must match the existing size (3392) at non-singleton dimension 1. Target sizes: [80, 3000]. Tensor sizes: [80, 3392] 🤗Transformers	1	749	May 13, 2024