Hi, I want to get the final hidden state representations of few sentences. So, I decided to use the T5EncoderModel and my code from this example from huggingface: T5 When I initialize the T5Encoder model, I get a warning saying Some weights of T5EncoderModel were not initialized from the model che…

Initializing T5Encoder model

arunwzd June 8, 2022, 3:41pm 2

@sgugger can you help me understand the issue?

Topic		Replies	Views
Warning when loading T5 encoders 🤗Transformers	3	1998	May 15, 2023
How to use T5 for sentence embedding? Research	6	16075	May 27, 2023
Load EncoderDecoderModel from a checkpoint Models	0	296	March 9, 2023
How to use the encoder only from T5? Beginners	0	678	April 9, 2022
Untrained T5 model outputting logits that argmax to the decoder_input_ids Beginners	0	501	September 28, 2022