is there any way to use encoder part of T5 model for representation learning?

How to use T5 for sentence embedding?

banucool September 12, 2020, 3:33pm 4

can we use pruned version of bert for feature extraction?does it make sense?

Topic		Replies	Views
Initializing T5Encoder model Models	2	2639	June 20, 2022
Extracting token embeddings from pretrained language models Beginners	9	22220	May 2, 2024
What should be used as sentence embedding for BertModel? Beginners	0	1911	May 24, 2021
How to use the encoder only from T5? Beginners	0	674	April 9, 2022
How to get sentence embedding using a fine-tuned model Intermediate	0	263	April 18, 2023