[Nov 16th Event] Sylvain Gugger: Supercharge your PyTorch training loop with πŸ€— Accelerate

Use this topic to ask your questions to Sylvain Gugger during his talk: Supercharge your PyTorch training loop with :hugs: Accelerate

You can watch it on YouTube or on Twitch at 9:50am PST

Can Accelarate help with hyperparameter optimization, same way Ray Tune does?

Can we do gradient accumulation with Accelerate

This is not provided out of the box right now, but it might be a future development.

1 Like

Yes, you can use anything you usually do in your training loop :slight_smile:

Thanks for the talk. It’s really a great tool. My question is:
Is Accelerate supported on Window platform? or just currently on Linux?