@morgan now I am having the issue that in distributed training all 8 workers are logging. I get 8 runs in my wandb 
is the issue resolved only by having the main process init wanbd? How do I know who is the main wandb process if I am using only thre trainer api?
solution: Is wandb in Trainer configured for distributed training? - #3 by brando