Fine tuning LLM with LORA resuming after stop

Federic · January 2, 2024, 9:55am

I everyone I am trying to fine tuning llama2 using lora on colab, I need to resume training from the last checkpoint available but I don’t know how to do it.

inkasaras · February 29, 2024, 2:29pm

Did you ever found a solution?

Topic		Replies	Views
Performance problems with finetuned model (Llama 2 7B based) Beginners	3	337	June 10, 2024
Fine-tuning don't work / bad results Beginners	3	1209	April 22, 2024
Making fine-tuned LLM model more stable Beginners	3	867	December 30, 2023
Combine LORA with full finetuning Intermediate	0	348	September 4, 2023
After fine tuning, saving and reloading the model, he is "forgetting" fine tuning 🤗Transformers	0	757	August 9, 2023

Fine tuning LLM with LORA resuming after stop

Related topics