Could you please guide me how loss function for T5 is computed? I mean it is a seq2seq model. Suppose it must map a sequence of X tokens to Y tokens, but it generates Z tokens. How Y and Z are compared to calculate loss?

What is loss function for T5

nielsr November 15, 2021, 5:56pm 4

Yes, you can use it here too.

You can leverage HuggingFace Datasets for this.

Topic		Replies	Views
Question regarding T5ForConditionalGeneraton loss in the example Beginners	0	324	January 4, 2021
Using Trainer class with T5 - what is returned in EvalPrediction dict? 🤗Transformers	8	5323	February 14, 2022
Finetuning T5 on translation task 🤗Transformers	0	492	September 10, 2021
T5 fine tuning, loss difference when using labels and decoder_input_ids 🤗Transformers	2	1182	October 12, 2020
How to add a custom objective function based on the generated target sentence tokens from a T5 model during training? Models	0	239	March 17, 2023