I am creating a tensor in the main process and would like to send it to other processes. Currently I’m doing the following:
from accelerate.utils import broadcast
x = None
if accelerator.is_local_main_process:
x = <do some computation>
x = broadcast(x, from_process=0)
Please help me fix this