RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking arugment for argument index in method wrapper_index_select)

pchhapolika · May 11, 2023, 2:17pm

Hi @ehalit , I am also facing the similar issue when training on 2 or more GPU’s. Do I need to change my DemoDataset(Dataset): class? RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cuda:0!

Kindly help, please!

Topic		Replies	Views
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument index in method wrapper__index_select) Beginners	2	1665	July 30, 2023
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! 🤗Accelerate	1	525	May 31, 2024
Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:3! (when checking argument for argument index in method wrapper_CUDA__index_select) Models	0	349	December 25, 2023
Trainer.train throws RuntimeError: Expected all tensors to be on the same device Beginners	5	2958	May 17, 2023
Expected all tensors to be on the same device Beginners	3	9274	April 30, 2022