Fine tune deta using lora

Beginners
1

hey
i want to train a deta (detr) model with a swin backbone on a custom dataset, im using lora to train some parts of the backbone. how can i train also train the decoder, encoder and heads?

thx!

2

The HuggingFace LoraConfig class has a target_modules parameter that you can use to set the modules LoRA should be applied to.

1 Like