I am trying to fine tune Falcon7B with only little ressources.
I found several notebooks and tutorials on how to do it with T4 Colab or only Kaggle.
But I keep encountering the same error related to this crucial step:
model = prepare_model_for_kbit_training(model)
TypeError: FalconPreTrainedModel._set_gradient_checkpointing() got an unexpected keyword argument ‘enable’
Thank you for your help
gradient_checkpointing to false
Since it’s an online Notebook, I cant modify the code source, do you have an idea of how I can modify it from the notebook itsefl ?
Here is the Notebook
Thank you for your answer.
It seems that I can’t change the source code itself.
here is the notebook Google Colab
Do you know what I should change on the notebook in order to make it work ?
@MGDragon I am also having this issue, please let me know if you find solution for this error.
model = prepare_model_for_kbit_training(model,use_gradient_checkpointing=False)
This should work, and also reduce the batch size afterwards!