I want to merge my PEFT adapter model with the base model and make a fully new model

Beginners
2

Have you tried the method merge_and_unload from PeftModel ad shown in this thread Help with merging LoRA weights back into base model :-) - #7 by accOne996795