Apply PEFT on ViT

🤗Transformers
1

For my research I am experimenting with Prefix tuning applied on Vision Transformers, @sayakpaul Could you give some pointers to implement changes in ViT module.

Thanks

2 Likes
2

Hey, were you ever able to figure out how to apply prompt/prefix tuning on ViT?

1 Like
3

I found a paper that seems to be related for now.