Questions on distilling [from] T5

🤗Transformers
9

You shouldn’t need to download it locally. What commit of transformers are you at?

AutoModelForSeq2SeqLM.from_pretrained('t5-small')

works for me. Make sure you don’t have a dir called t5-small.