Fine Tuning Whisper

Hey @sanchit-gandhi-I’ve been following your Fine Tuning Whisper blog and forums posts all over hugging face and i’ve been trying to fine tune Whisper’s medium-en model on some of my own datasets with some success but mostly failures. I’m not well learned on ML/AI but I am able to get around. I was wondering if I could potentially get your consultation on my notebook to see what i might be doing incorrectly? When I attempt to train my model my wer becomes erratic. Not sure what might be the problem.