Hi! I have a newbie question regarding the Accelerator object. I have a code that consists of several training modules, and I’m wondering if it is okay to instantiate an Accelerator object in each of the modules? Or would it be better to create something like a config file to share a global Accelerator object across all modules?
It’s fine to have several accelerator objects, they will all share the same state (which contains your distributed config).
1 Like