I am fine-tuning T5 for paraphrase generation and want to add a diversity measure for the generated sentences in the loss function. After reading the source code , I still have no clue how to add that.

T5 user defined loss function

peggy September 23, 2020, 4:38pm 14

Hi. Thanks for your explanation.
Do you have a paper, or some key-words to search on the thing you said about training a function to do the sampling?

Cross Entropy Weighted

Topic		Replies	Views
The output of T5 is not consistent on multiple sequences 🤗Transformers	1	810	May 11, 2022
What is loss function for T5 Models	13	12201	February 25, 2024
T5 Model Generate and Model Outputs Vastly Different Beginners	1	660	September 11, 2022
How to get the logits for the T5 model when using the `generate` method for inference? Beginners	3	4765	April 18, 2023
Loss in a Seq2Seq task 🤗Transformers	0	113	June 5, 2024