Accelerate only supports on the main process 
If there is a need or desire to do logging across all of them, we can support that. But all of the logging functionalities are purposefully limited to just the main process.
Also you don’t need to do if accelerator.is_main_process for init specifically if you are building off main. (This will be propagated to the next release)