How to merge LoRa weights with base model?

Bastao May 3, 2023, 7:13pm 1

Is it possible to merge LoRa adapter weights with a base model like Bloomz?

2 Likes

Topic		Replies	Views
How do I merge a lora adapter back into the model weights? Beginners	1	3139	August 23, 2023
Help with merging LoRA weights back into base model :-) Beginners	11	62484	February 6, 2025
Challenges with Uploading Merged LoRA-Enhanced Model to Hugging Face and Langchain Hub Models	0	570	July 1, 2023
I want to merge my PEFT adapter model with the base model and make a fully new model Beginners	4	4563	February 5, 2025
How to merge multiple LoRA back to base model? 🤗Transformers	0	666	December 14, 2023