Fine-Tune LoRA adapter starting from existing adapter

🤗Transformers
1

Hello, is it possible to train a LoRA adapter, and use those weights as the starting weights for a new adapter?

2

Hi, I’m facing the same issue, have you figured out a way to do this?
thanks.