There are many examples showing how to train T5 in PyTorch, e.g.: https://github.com/patil-suraj/exploring-T5/blob/master/T5_on_TPU.ipynb , but none so far for Tensorflow. Many people have been asking on :hugs:transformers: https://github.com/huggingface/transformers/issues/3626 . Does anybody have…

How to train T5 with Tensorflow

HarrisDePerceptron August 29, 2020, 12:10pm 5

Any luck on those Tensorflow T5 notebook?

Fine-tuning T5 on Tensorflow

Topic		Replies	Views
Using Trainer class with T5 - what is returned in EvalPrediction dict? 🤗Transformers	8	4617	February 14, 2022
Extremely confusing or non-existent documentation about the Seq2Seq trainer Beginners	1	3441	December 16, 2021
T5 Model Problems - Constant Loss (doesn't go down) Models	2	1320	August 18, 2023
Fine-tuning T5 with Trainer for novel task Models	1	1047	September 1, 2021
Do you train all layers when fine-tuning T5? Beginners	7	5487	September 26, 2023