Hi! I tried to look for this but haven’t figured out some definite explanations. What’s the difference between these two? I’m mainly using DDP on one node (multiple machines), so it seems world_size
is the actual #gpu, and n_gpu
is always 1. Then what is n_gpu
used for? Thanks!