How to use lr_scehuler in Trainer? it seems that whenever I pass AdamW optimizer, it also need the dictionary of params to tune. Since I am using just plain Trainer (not being intimate with PyTorch) The parameters are not exposed to pass to AdamW yielding an error. Does anyone have an idea of how I…

How do use lr_scheduler

Owos May 12, 2023, 10:18am 9

Hi @lewtun , please how do I use the pytorch cyclic lr_scheduler here in the hugginface trainer.
torch.optim.lr_scheduler.CyclicLR

Topic		Replies	Views
Trainer optimizer 🤗Transformers	11	9055	August 7, 2021
Using Cosine LR scheduler via TrainingArguments in Trainer Beginners	10	11902	June 3, 2024
Hyperparameters for lr_scheduler_type in Trainer Arguments Beginners	2	13085	March 5, 2024
Use torch.optim.lr_scheduler.CyclicLR with Trainer 🤗Transformers	0	432	May 12, 2023
How to use lr_scheduler_kwargs param in TrainingArguments? 🤗Transformers	6	80	June 25, 2025