Hi, can anyone confirm whether my approach is correct or not, I’m trying to fine-tune Wav2Vec2 on a large dataset hence I need to make sure the process is correct: I want to use an LR scheduler - Cosine scheduler with warmup, it can be extracted in the general training through transformers.get_cosi…

Using Cosine LR scheduler via TrainingArguments in Trainer

berkecr September 29, 2023, 6:55am 6

I found this, hope it helps.

2 Likes