How to use lr_scehuler in Trainer? it seems that whenever I pass AdamW optimizer, it also need the dictionary of params to tune. Since I am using just plain Trainer (not being intimate with PyTorch) The parameters are not exposed to pass to AdamW yielding an error. Does anyone have an idea of how I…

How do use lr_scheduler

jaideepcs September 1, 2023, 3:38pm 10

@Owos did you figured it out ?
@lewtun

Topic		Replies	Views
Trainer optimizer 🤗Transformers	11	9252	August 7, 2021
Using Cosine LR scheduler via TrainingArguments in Trainer Beginners	10	12438	June 3, 2024
Hyperparameters for lr_scheduler_type in Trainer Arguments Beginners	2	13925	March 5, 2024
Use torch.optim.lr_scheduler.CyclicLR with Trainer 🤗Transformers	0	448	May 12, 2023
How to use lr_scheduler_kwargs param in TrainingArguments? 🤗Transformers	6	207	June 25, 2025