[Nov 16th Event] Sylvain Gugger: Supercharge your PyTorch training loop with 🤗 Accelerate

[sgugger]

Use this topic to ask your questions to Sylvain Gugger during his talk: Supercharge your PyTorch training loop with Accelerate

You can watch it on YouTube or on Twitch at 9:50am PST

[alivahdat]

Can Accelarate help with hyperparameter optimization, same way Ray Tune does?

[anindabitm]

Can we do gradient accumulation with Accelerate

[sgugger]

@alivahdat

Can Accelarate help with hyperparameter optimization, same way Ray Tune does?

This is not provided out of the box right now, but it might be a future development.

[sgugger]

@anindabitm

Can we do gradient accumulation with Accelerate

Yes, you can use anything you usually do in your training loop

[ivanlau]

Hi,
Thanks for the talk. It’s really a great tool. My question is:
Is Accelerate supported on Window platform? or just currently on Linux?
Thanks