OSError: Unable to load weights from pytorch checkpoint file

Hi Lewis,
how would you load a model that is saved with save_pretrained from gpu to cpu?

I can’t load the state_dict from model_bin, is the only way around it to load the model onto the gpu and then save the statedict ?

you can check if Accelerate is installed,if not try to pip install accelerate,it works for me