Can I dynamically add or remove LoRA weights in the transformer library like diffusers

Hi!

Yes, with PEFT library you can merge and unmerge LORA adapters to any model. See docs for more information

1 Like