Tensor size error in PEFT(Prefix Tuning)

🤗Transformers
1

Hi,

I am trying Prefix Tuning using PEFT library on a multilabel classification problem. I am getting the following error:
“RuntimeError: The size of tensor a (512) must match the size of tensor b (492) at non-singleton dimension 1”

The num_virtual_tokens is set to 20. Model used is: “bert-base-uncased”

Any help in resolving this error?

Thanks,
Shreyans