Hi I’m trying to fine-tune model with Trainer in transformers, Well, I want to use a specific number of GPU in my server. My server has two GPUs,(index 0, index 1) and I want to train my model with GPU index 1. I’ve read the Trainer and TrainingArguments documents, and I’ve tried the CUDA_VISIBL…

Setting specific device for Trainer

bhadresh-savani May 6, 2021, 5:38am 6

Is it implemented?, I could not figure out how to set device one for training i tried above methods.

2 Likes

Topic		Replies	Views
How to set gpu device for hugging trainer? 🤗Transformers	1	1097	September 16, 2024
How to restrict training to one GPU if multiple are available, co 🤗Transformers	4	14419	November 1, 2023
How to set the training device to cuda:1 ? By default, TrainerArgument seems to move model to cuda:0 Beginners	3	342	September 25, 2024
How to restrict Trainer to use certain GPUs? Beginners	2	535	February 25, 2024
Limit GPU cores for training 🤗Transformers	4	1545	September 14, 2023