'T5ForConditionalGeneration' object has no attribute '_prune_heads'

🤗Transformers
1

Hi guys

I have been following the documentation here to prune heads but keep getting this error AttributeError: ‘T5ForConditionalGeneration’ object has no attribute ‘_prune_heads’

This is my code, I was just following the docs

mycode
mycode1009×208 29.3 KB

c

2

Hi @ceddyla,

Did you figure out a solution for this problem?

I’m facing same issue and raised a Github issue here - https://github.com/huggingface/transformers/issues/27044