Implentation of QA-LoRA

Intermediate
1

Hello,

how do I implement QA-LoRA with Pytorch? There is code in the paper of QA-LoRA, but I have no idea, how to implement the code.

I want to fine-tune models like BERT or Llama-2 with QA-LoRA.

Thanks in advance.

2

Hi team,
I am having similar requirement.

Like to use QA-LoRA to fine tune models like owl-ViTv2 and Grounding Dino.

Sample reference code will be useful.

with thanks

1 Like
3

Hey, did you got any sample code to use LoRa for Grounding Dino