Hello, I’m having a problem in using CUDA with Trainer.train(). This kind of problem is not present when training models using the whole PyTorch pipeline, but I would love to understand where I am getting it wrong to use also this powerful class. I know for sure this is very silly, but I’m a begin…

Can I use CUDA with Trainer.train?

mariosasko May 6, 2022, 12:04pm 2

Hi! The first error is a known bug (see Sending a Dataset or DatasetDict to a GPU). Can you update your installation of transformers with pip install -U transformers and rerun the first snippet?

2 Likes

Topic		Replies	Views
How to get the Trainer API to use GPU? Beginners	0	1458	May 21, 2021
Huggingface transformer sequence classification 🤗Transformers	3	486	March 26, 2022
Trainer.train throws RuntimeError: Expected all tensors to be on the same device Beginners	5	2915	May 17, 2023
Using 3 GPUs for training with Trainer() of transformers 🤗Transformers	2	1951	October 18, 2023
Training model: RuntimeError: Expected a 'cuda' device type for generator but found 'cpu' Beginners	1	589	April 21, 2024

Can I use CUDA with Trainer.train?

Related Topics