My friend who wishes to remain anonymous asked a good question about T5 that I couldn’t answer: Say we have a model that predicts sentiment – answers are “positive/negative/neutral” – for something like RoBERTa we’d add a layer, slap on a softmax – and we get both argmax predictions, and some notio…

T5: classification using text2text?

sshleifer September 25, 2020, 2:38pm 7

That’s cool suraj, thanks! Is it possible to do that with forward?

Topic		Replies	Views
Finetuning T5 for multi class classification Intermediate	0	951	January 6, 2022
How to get the result probabilities fromT5 decoding output? 🤗Transformers	1	1001	October 30, 2022
T5 for classification task 🤗Transformers	0	488	April 25, 2023
How to get the probabilities of each class when we use T5 or Flan Awesome paper	0	391	January 23, 2024
T5ForConditionalGeneration, How to get prediction probabilities or logits at the inference time? (to calculate perplexity) 🤗Transformers	0	691	April 5, 2022