Hi I’m trying to fine-tune model with Trainer in transformers, Well, I want to use a specific number of GPU in my server. My server has two GPUs,(index 0, index 1) and I want to train my model with GPU index 1. I’ve read the Trainer and TrainingArguments documents, and I’ve tried the CUDA_VISIBL…

Setting specific device for Trainer

sgugger August 21, 2020, 1:10pm 4

Mmmm, looking at the code, I can see that Trainer ignores the default device indeed. Will fix that soon.

4 Likes

Topic		Replies	Views
How to set gpu device for hugging trainer? 🤗Transformers	1	1097	September 16, 2024
How to restrict training to one GPU if multiple are available, co 🤗Transformers	4	14421	November 1, 2023
How to set the training device to cuda:1 ? By default, TrainerArgument seems to move model to cuda:0 Beginners	3	343	September 25, 2024
How to restrict Trainer to use certain GPUs? Beginners	2	535	February 25, 2024
Limit GPU cores for training 🤗Transformers	4	1546	September 14, 2023