I’m noticing that when using the HF Trainer, the Trainer object doesn’t seem to check for main process using the Accelerator. This was a little counterintuitive because I thought that using something like accelerator.wait_for_everyone() was recommended.
Is this intentional? Or am I misunderstanding something?
Thanks.