I want to use GPUs with different conditions. But I think the accelerator.device() is always cuda:0. even I wanted to rewrite it like cuda:1 or cuda:2 but it couldn’t be modified. How to fix this problem?

[image] hanjohn: os.environ['CUDA_VISIBLE_DEVICES'] = str(6) You cannot do this in your python file like that, this has to be done before your python file has been called, or before torch/accelerate/anything that init’s the GPU has been imported (possibly). So solutions: accelerate launch -…

How to use specific gpu in accelerate?

🤗Accelerate

nastyhilda November 21, 2023, 5:57am 4

exactly the same situation!!

Topic		Replies	Views
How to use specified GPUs with Accelerator to train the model? Beginners	15	29667	August 23, 2024
Use CUDA_VISIBLE_DEVICES with accelarator 🤗Accelerate	1	1175	August 30, 2021
[SOLVED] accelerate.Accelerator(): CUDA error: invalid device ordinal 🤗Accelerate	11	10327	July 6, 2024
Can't set attribute 'device', for some reason i need to train model on only one gpu on a mutlti gpu machine Beginners	2	420	September 16, 2024
Accelerate doesn't seem to use my GPU? 🤗Accelerate	7	5909	September 18, 2024

How to use specific gpu in accelerate?

Related topics