I am fine-tuning T5 for paraphrase generation and want to add a diversity measure for the generated sentences in the loss function. After reading the source code , I still have no clue how to add that.

T5 user defined loss function

mengyahu August 7, 2020, 2:59pm 13

Thanks! This guidance is very helpful!

Topic		Replies	Views
TFT5ForConditionalGeneration with custom loss Beginners	0	451	April 4, 2022
Cross Entropy Loss and loss of HuggingFace T5ForConditionalGeneration does not matches 🤗Transformers	11	5294	November 29, 2023
Question regarding T5ForConditionalGeneraton loss in the example Beginners	0	323	January 4, 2021
T5 for conditional generation: getting started Beginners	20	18678	July 19, 2023
How to output loss from model.generate()? 🤗Transformers	16	6057	January 7, 2025