How do I use a trained LORA, unmerged?

I have trained a LORA adapter for LLaVa-1.5 and I want to input text-image data to both the LLaVa-1.5 model and the LORA adapter separately like how I trained the adapter. How can I do this and where is the documentation?