I noticed that when I’m training a model using the Accelerate library that the number of syncable runs that get outputted to wandb is the same as the number of GPUs I configure Accelerate with. If I have 4 GPUs available to me and configure Accelerate to utilize 2 of them, there will be two output d…

Hey @aclifton314 , you can use “grouping” in wandb to achieve what you’re trying to do I think. One way is to pass the “group” argument to wandb.init with your own name or id for the experiment, e.g. “my_experiment_1”. Then you will be able to group runs from the same run into one in the UI, e.g. y…

Multiple wandb outputs

🤗Accelerate

aclifton314 August 22, 2022, 8:26pm 8

@muellerzr @morgan done and done! works great! Thank you both!

1 Like

Topic		Replies	Views
Wandb.watch in accelerate library 🤗Accelerate	6	2341	May 1, 2024
Wandb tracker run and project specifier 🤗Accelerate	4	1694	June 27, 2022
Weights & Biases sweep with multi gpu accelerate launch 🤗Accelerate	4	2674	May 28, 2024
Tracking summarization example results 🤗Accelerate	1	1992	December 13, 2022
Logging & Experiment tracking with W&B 🤗Transformers	78	45396	February 28, 2024

Multiple wandb outputs

Related topics