Hi, i am trying to finetune phi 1.5 on a custom dataset using QLora. When i run:
model = prepare_model_for_kbit_training(model)
I receive the following error
AttributeError: âMixFormerSequentialForCausalLMâ object has no attribute â_set_gradient_checkpointingâ
peft version : 0.5.0
transformer: 4.33.2
2 Likes
Same problem here, Because of that the GPU is filling up like crazy. If you got it solved by now, Could you share here?
Excuse me, did you solve this ?