The new learning rate is invalid,after "accelerator.load_state"

AisingioroHao0 September 3, 2023, 8:06am 1

After “accelerator.load_state” it seems that the learning rate has changed back. How to use the new learning rate

Topic		Replies	Views
How to check or manually control the learning rate used in training? 🤗Transformers	1	7934	May 6, 2022
Training Resumes with Increased Loss Despite Checkpoint Loading Beginners	0	82	September 5, 2024
Settings warmup_steps=1 dosn't fixed the learning rate , which change every epcohs Beginners	2	181	January 10, 2024
Resume Training with Lower Learning Rate Beginners	3	1248	January 5, 2025
Continue fine-tuning with Trainer() after completing the initial training process Beginners	9	5552	January 19, 2022