Hi, can anyone confirm whether my approach is correct or not, I’m trying to fine-tune Wav2Vec2 on a large dataset hence I need to make sure the process is correct: I want to use an LR scheduler - Cosine scheduler with warmup, it can be extracted in the general training through transformers.get_cosi…

Using Cosine LR scheduler via TrainingArguments in Trainer

ChayanM May 21, 2024, 5:00am 10

Thank you so much @edwarddgao. It’s working perfectly.

Topic		Replies	Views
Hyperparameters for lr_scheduler_type in Trainer Arguments Beginners	2	13085	March 5, 2024
How do use lr_scheduler Beginners	11	14855	January 23, 2024
How to use lr_scheduler_kwargs param in TrainingArguments? 🤗Transformers	6	79	June 25, 2025
Cosine LR Scheduler not decaying Beginners	0	56	September 16, 2024
Learning rate, LR scheduler and optimiser choice for fine-tuning GPT2 Beginners	1	7240	September 3, 2020