just saw this. Pasting this as a ref: Hugging Face Trainer? 路 Issue #144 路 huggingface/accelerate 路 GitHub