Huggingface implement new Optimizer

gordonhu May 25, 2023, 7:45am 1

Hi, we should incorporate the newly released Sophia optimizer into huggingface!

2 Likes

Topic		Replies	Views
Huggingface Optimizer 🤗Optimum	2	479	May 25, 2023
Trainer class optimization for transformer models Models	0	420	January 8, 2022
Change Transformers version on Huggingface Inference Endpoint? 🤗Transformers	0	209	February 23, 2024
Best Practices for Optimizing Model Training 🤗Transformers	0	309	January 29, 2024
[Possibly] Forgotten TODO Comment for `TrainingArguments.default_optim` 🤗Transformers	1	31	March 14, 2025