Hi, can anyone confirm whether my approach is correct or not, I’m trying to fine-tune Wav2Vec2 on a large dataset hence I need to make sure the process is correct:
I want to use an LR scheduler - Cosine scheduler with warmup, it can be extracted in the general training through
transformers.get_cosine_schedule_with_warmup. What I’m not clear with is: How should I use this in training args to pass on to the Trainer? It has an argument:
lr_scheduler_type should I pass an instance of the
transformers.get_cosine_schedule_with_warmup with this lr_scheduler_type ? or is there something else I’m missing?
Any help is appreciated, Thanks!