If you want to use DDP (distributed data parallel) you do need to launch the script with python -m torch.distributed.launch.
1 Like
If you want to use DDP (distributed data parallel) you do need to launch the script with python -m torch.distributed.launch.