I’m trying to train an ASR model using Transformers, Datasets and lightning. I want to use lightning as it will make it easier to train on my custom dataset. I have posted the code I’m using below as well as some loss curves and WER curves. I’ve trained on the librispeech dataset, only including u…

Can't get Wav2Vec to converge

pfjf2 May 24, 2023, 8:14am 3

Topic		Replies	Views
Wav2vec2 not converging when finetuning 🤗Transformers	7	2014	June 15, 2021
Wav2Vec2 ASR Fine tuneing Improvement Beginners	0	118	November 7, 2023
Why is Wav2Vec pretraining loss not decreasing? Models	10	2248	April 29, 2022
Wav2Vec2: loss growing in training and validation after few epochs Models	5	1518	February 1, 2024
Wav2VecForPreTraining - Not able to run trainer.train() Beginners	3	602	October 19, 2021