Hi I’m trying to fine-tune model with Trainer in transformers, Well, I want to use a specific number of GPU in my server. My server has two GPUs,(index 0, index 1) and I want to train my model with GPU index 1. I’ve read the Trainer and TrainingArguments documents, and I’ve tried the CUDA_VISIBL…

Setting specific device for Trainer

ben9004 August 22, 2020, 3:03am 5

I got a discussion with my mate, He suggested to reinstall GPU driver or restart the server.
I’ll try it and tell what happens to you.
Thanks a lot.

1 Like

Topic		Replies	Views
How to set gpu device for hugging trainer? 🤗Transformers	1	1097	September 16, 2024
How to restrict training to one GPU if multiple are available, co 🤗Transformers	4	14418	November 1, 2023
How to set the training device to cuda:1 ? By default, TrainerArgument seems to move model to cuda:0 Beginners	3	341	September 25, 2024
How to restrict Trainer to use certain GPUs? Beginners	2	535	February 25, 2024
Limit GPU cores for training 🤗Transformers	4	1545	September 14, 2023