Hi!
Yes, with PEFT library you can merge and unmerge LORA adapters to any model. See docs for more information