Hello, I’m having a problem in using CUDA with Trainer.train(). This kind of problem is not present when training models using the whole PyTorch pipeline, but I would love to understand where I am getting it wrong to use also this powerful class. I know for sure this is very silly, but I’m a begin…

Can I use CUDA with Trainer.train?

mariosasko May 6, 2022, 12:04pm 2

Hi! The first error is a known bug (see Sending a Dataset or DatasetDict to a GPU). Can you update your installation of transformers with pip install -U transformers and rerun the first snippet?

2 Likes

Topic		Replies	Views
How to get the Trainer API to use GPU? Beginners	0	1261	May 21, 2021
Huggingface transformer sequence classification 🤗Transformers	3	424	March 26, 2022
Trainer.train throws RuntimeError: Expected all tensors to be on the same device Beginners	5	2402	May 17, 2023
Using 3 GPUs for training with Trainer() of transformers 🤗Transformers	2	1283	October 18, 2023
Is Transformers using GPU by default? Beginners	6	117137	December 11, 2023

Can I use CUDA with Trainer.train?

Related Topics