My friend who wishes to remain anonymous asked a good question about T5 that I couldn’t answer: Say we have a model that predicts sentiment – answers are “positive/negative/neutral” – for something like RoBERTa we’d add a layer, slap on a softmax – and we get both argmax predictions, and some notio…

T5: classification using text2text?

SaraAmd June 20, 2023, 4:39pm 15

@santon My class labels have multiple tokens and it seems it does not work for me. I have three classes but the output tensor after the softmax is [6 3] which does not make sense. Can anyone help me with this task

Topic		Replies	Views
Finetuning T5 for multi class classification Intermediate	0	951	January 6, 2022
How to get the result probabilities fromT5 decoding output? 🤗Transformers	1	1001	October 30, 2022
T5 for classification task 🤗Transformers	0	488	April 25, 2023
How to get the probabilities of each class when we use T5 or Flan Awesome paper	0	391	January 23, 2024
T5ForConditionalGeneration, How to get prediction probabilities or logits at the inference time? (to calculate perplexity) 🤗Transformers	0	691	April 5, 2022

T5: classification using text2text?

Related topics