My friend who wishes to remain anonymous asked a good question about T5 that I couldn’t answer: Say we have a model that predicts sentiment – answers are “positive/negative/neutral” – for something like RoBERTa we’d add a layer, slap on a softmax – and we get both argmax predictions, and some notio…

T5: classification using text2text?

SaraAmd June 22, 2023, 8:09pm 16

To me .expand does not make sense because you do not want the logits for the input seq, you just need it for the class labels

Topic		Replies	Views
Finetuning T5 for multi class classification Intermediate	0	951	January 6, 2022
How to get the result probabilities fromT5 decoding output? 🤗Transformers	1	1001	October 30, 2022
T5 for classification task 🤗Transformers	0	488	April 25, 2023
How to get the probabilities of each class when we use T5 or Flan Awesome paper	0	391	January 23, 2024
T5ForConditionalGeneration, How to get prediction probabilities or logits at the inference time? (to calculate perplexity) 🤗Transformers	0	691	April 5, 2022