T5-11b model not available

[flavienbwk]

Hi,

I would like to download the t5-11b model but it seems like it is unavailable. Is that normal ?

Thanks

[flavienbwk]

I’ve been using these links as a workaround :

• https://s3.amazonaws.com/models.huggingface.co/bert/t5-11b-config.json
• https://s3.amazonaws.com/models.huggingface.co/bert/t5-11b-pytorch_model.bin

[dynamicwebpaige]

Hi @flavienbwk! Thanks for the question.

Unfortunately, inference for t5-11b has been turned off, due to the model’s size (see screenshot below). A single GPU will most likely not have enough memory to fully load the model, as the weights alone amount to well over 40 GB.