Huggingface implement new Optimizer

gordonhu May 25, 2023, 7:45am 1

Hi, we should incorporate the newly released Sophia optimizer into huggingface!

2 Likes

Topic		Replies	Views
Huggingface Optimizer 🤗Optimum	2	412	May 25, 2023
Retrieval Augmented Generation using Transformer Eco System 🤗Transformers	0	245	October 12, 2023
Any way we can use Fnet? 🤗Transformers	0	189	July 28, 2021
How to Optimize Fine-tuning in Hugging Face Transformers? Beginners	0	122	March 5, 2024
New to Huggingface Beginners	0	273	June 10, 2023