Hi, I am trying to finetune T5 using the Trainer class. I understand that Trainer doesn’t work out-of-the-box for seq2seq tasks and saw @patrickvonplaten ’s https://github.com/huggingface/transformers/pull/5840 which extends the Trainer class to work for Bert2Bert. Is my understanding correct that t…

Using Trainer class with T5 - what is returned in EvalPrediction dict?

valhalla September 8, 2020, 11:38am 3

For more T5 related tips T5 Finetuning Tips

Topic		Replies	Views
Trainer class, compute_metrics and EvalPrediction 🤗Transformers	6	13203	October 28, 2020
Extremely confusing or non-existent documentation about the Seq2Seq trainer Beginners	1	4172	December 16, 2021
Logging training accuracy using Trainer class 🤗Transformers	8	10155	December 2, 2021
T5 variants return Training Loss 0 and Validation loss nan while fine tuning 🤗Transformers	8	4773	November 10, 2024
Custom model for Trainer 🤗Transformers	1	343	July 8, 2023