Hi all, I’m facing these issue in these days but I haven’t found a solution. I’m using the simpletransformers, a wrapper for your library, the main code of the model that I’m trying to train, that is T5, is here . I’ve trained the model correctly and I would like to continue the training for more …

RuntimeError: arguments are located on different GPUs

valhalla October 24, 2020, 8:26am 2

Would be better if you create an issue in simpletransformers repo.

Topic		Replies	Views
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cuda:0! 🤗Transformers	28	114418	November 17, 2024
Finetuning T5-large on Multiple GPUs 🤗Transformers	0	1091	April 26, 2023
torch.nn.DataParallel Mistral-7B-Instruct RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cuda:0! Beginners	1	65	August 20, 2024
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking arugment for argument index in method wrapper_index_select) Beginners	5	46539	July 4, 2023
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:7 and cuda:0! 🤗Transformers	2	197	March 25, 2025