Hey @sanchit-gandhi-I’ve been following your Fine Tuning Whisper blog and forums posts all over hugging face and i’ve been trying to fine tune Whisper’s medium-en model on some of my own datasets with some success but mostly failures. I’m not well learned on ML/AI but I am able to get around. I was wondering if I could potentially get your consultation on my notebook to see what i might be doing incorrectly? When I attempt to train my model my wer becomes erratic. Not sure what might be the problem.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Problem with finetuning model whisper | 0 | 96 | November 7, 2024 | |
| How don't destroy the general learning of whisper throught fine tune | 0 | 65 | December 17, 2024 | |
| Whisper fine-tuning on Librispeech makes WER worse | 6 | 2492 | June 26, 2023 | |
| Layer specific Fine Tuning whisper | 0 | 12 | August 24, 2024 | |
| Fine Tuning Whisper on my own Dataset with a customized Tokenizer | 16 | 12624 | February 12, 2024 |