I’m trying to train an ASR model using Transformers, Datasets and lightning. I want to use lightning as it will make it easier to train on my custom dataset. I have posted the code I’m using below as well as some loss curves and WER curves. I’ve trained on the librispeech dataset, only including u…

Can't get Wav2Vec to converge

pfjf2 May 24, 2023, 8:14am 3

Topic		Replies	Views
Unable to train model (Loss is 0.000000) DeepSpeed	2	1061	October 17, 2023
Wav2vec2 not converging when finetuning 🤗Transformers	7	2446	June 15, 2021
Wav2Vec2 ASR Fine tuneing Improvement Beginners	0	166	November 7, 2023
0 Loss. HF trainer integration Models	0	34	November 20, 2024
Why is Wav2Vec pretraining loss not decreasing? Models	10	2564	April 29, 2022