How to merge LoRa weights with base model?

Bastao May 3, 2023, 7:13pm 1

Is it possible to merge LoRa adapter weights with a base model like Bloomz?

2 Likes

Topic		Replies	Views
How do I merge a lora adapter back into the model weights? Beginners	1	2492	August 23, 2023
Help with merging LoRA weights back into base model :-) Beginners	9	34879	May 1, 2024
I want to merge my PEFT adapter model with the base model and make a fully new model Beginners	2	2514	January 21, 2024
SFTTrainer Merge LoRA weights back into base model? Models	0	936	December 24, 2023
Lora extension with weight 🧨 Diffusers	0	465	August 1, 2023