Can we use t5 for decoder only?

manivignesh August 17, 2023, 5:46am 1

i have to perform some mathematical operation on word embeddings. To do that i need to pass the result embeddings to decoder after performing math operations. Is that possible?

Topic		Replies	Views
Turn word embedding to word id (using T5 decoder) 🤗Transformers	0	292	January 8, 2022
Should decoder only models like GPT used for classification? Beginners	1	485	April 20, 2024
Postional Encoding calculation for T5 🤗Transformers	0	156	March 16, 2023
Fine-tuning CodeT5 for Regression Beginners	0	83	February 13, 2024
Using T5 pre-trained weight for Text style transfer Models	1	1458	June 25, 2021

Can we use t5 for decoder only?

Related Topics