i have finetuned llama2 7b chat hf with peft and qlora. i have saved the weights (adapters_model.bin) i need to perform a finetuning on top of that weights. how can i do it.
this is my google colab for finetuning: Google Colab
i have finetuned llama2 7b chat hf with peft and qlora. i have saved the weights (adapters_model.bin) i need to perform a finetuning on top of that weights. how can i do it.
this is my google colab for finetuning: Google Colab