Hi, I am trying to finetune T5 using the Trainer class. I understand that Trainer doesn’t work out-of-the-box for seq2seq tasks and saw @patrickvonplaten ’s https://github.com/huggingface/transformers/pull/5840 which extends the Trainer class to work for Bert2Bert. Is my understanding correct that t…

Using Trainer class with T5 - what is returned in EvalPrediction dict?

valhalla September 8, 2020, 11:48am 5

It works :). It can not calculate generative metrics right now , but that’s being added in Seq2SeqTrainer.

Topic		Replies	Views
Trainer class, compute_metrics and EvalPrediction 🤗Transformers	6	14616	October 28, 2020
[Urgent] trainer.predict() and model.generate creates totally different predictions 🤗Transformers	4	6928	February 1, 2021
What does EvalPrediction.predictions contain exactly? Beginners	8	8564	August 3, 2023
Trainer.evaluate() with text generation Beginners	5	3554	December 31, 2021
Seq2SeqTrainer produces error during validation when using T5 🤗Transformers	0	137	March 18, 2024