I have made config file using ‘accelerate config’, I gave below parameters : In which compute environment are you running? ([0] This machine, [1] AWS (Amazon SageMaker)): >0 Which type of machine are you using? ([0] No distributed training, [1] multi-CPU, [2] multi-GPU, [3] TPU): 2 How many dif…

Distributed GPU training not working

muellerzr November 30, 2023, 1:50pm 3

If using multinode you need a config file on each node, one with rank 0 one with rank 1

Topic		Replies	Views
Detecting single gpu within each node 🤗Accelerate	2	777	January 17, 2023
Multi-GPU Distributed Training using Accelerate on Windows 🤗Accelerate	0	1557	August 9, 2023
Accelerate on 1 GPU 🤗Accelerate	2	1918	April 8, 2022
No GPUs found in distributed mode 🤗Accelerate	0	958	March 1, 2023
Cannot create distributed environment 🤗Accelerate	0	390	February 28, 2023