I am trying to load t5-large (same for t5-small and t5-base) encoder as a feature extractor. I use the following command from transformers import T5EncoderModel M=T5EncoderModel.from_pretrained('t5-large') But I get warning msgs like this: Some weights of the model checkpoint at t5-large were not…

Warning when loading T5 encoders

arunwzd June 8, 2022, 3:39pm 3

@sgugger can you help me with this?

Topic		Replies	Views
Initializing T5Encoder model Models	2	2640	June 20, 2022
Load EncoderDecoderModel from a checkpoint Models	0	294	March 9, 2023
How to use the encoder only from T5? Beginners	0	674	April 9, 2022
Loading pytorch_pretrained_bert models with transformers Beginners	2	1903	April 29, 2021
No weights has been used to initialize the model 🤗Transformers	0	348	February 26, 2023