Hi, can anyone confirm whether my approach is correct or not, I’m trying to fine-tune Wav2Vec2 on a large dataset hence I need to make sure the process is correct: I want to use an LR scheduler - Cosine scheduler with warmup, it can be extracted in the general training through transformers.get_cosi…

Using Cosine LR scheduler via TrainingArguments in Trainer

ollibolli April 4, 2022, 5:48pm 3

Is there a list somewhere with the respective strings?

1 Like