Huggingface implement new Optimizer

🤗Transformers
1

Hi, we should incorporate the newly released Sophia optimizer into huggingface!

1 Like