Wav2vec2 not converging when finetuning

Oh I see.
I think wav2vec is having a hard time because the audio is so different to the one it was pretrained on.