How to perform finetuning on llama2 adapters

i have finetuned llama2 7b chat hf with peft and qlora. i have saved the weights (adapters_model.bin) i need to perform a finetuning on top of that weights. how can i do it.

this is my google colab for finetuning: Google Colab