RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cuda:0!

🤗Transformers
13

@ehalit would you mind sharing your script for loading falcon-7b-instruct directly? I am still getting this same error when trying to load falcon-7b-instruct. Many thanks!