Weights & Biases sweep with multi gpu accelerate launch

🤗Accelerate
2

Hey @berkin , I think this can be fixed by moving the following code under the test for whether its the main process, similar to how you have initialised wandb:

if main_process:    
    # Log configuration from wandb tracker
    learning_rate = wandb.config.learning_rate
    base_model_name = wandb.config.base_model_name
    resize_resolution = wandb.config.resize_resolution
    model_type = MODEL_TYPES[base_model_name]
2 Likes