If I have Accelerate set up to run on 4 GPUs, will the above solution save off a single model or do I need to indicate that accelerate should wait until all the processes are done calculating?
If I have Accelerate set up to run on 4 GPUs, will the above solution save off a single model or do I need to indicate that accelerate should wait until all the processes are done calculating?