How to run an end to end example of distributed data parallel with hugging face's trainer api (ideally on a single node multiple gpus)?

@muellerzr sorry for dragging this conversation…but now I have 8 wandb runs being made but I only need 1. You think is this line:

# report_to = "none"
report_to = "wandb"
if report_to != 'none':
    wandb.init(project="proj", entity="me", name='run_name', group='expt_name')

?

How have you stopped this?