Hi, can anyone confirm whether my approach is correct or not, I’m trying to fine-tune Wav2Vec2 on a large dataset hence I need to make sure the process is correct:
I want to use an LR scheduler - Cosine scheduler with warmup, it can be extracted in the general training through transformers.get_cosine_schedule_with_warmup
. What I’m not clear with is: How should I use this in training args to pass on to the Trainer? It has an argument: lr_scheduler_type
should I pass an instance of the transformers.get_cosine_schedule_with_warmup
with this lr_scheduler_type ? or is there something else I’m missing?
Any help is appreciated, Thanks!