T5 [ input & target ] text

Beginners
1

Hello,

I am trying to fine tune mt5 on seq2seq tasks with my own dataset, and the dataset has input and target columns.

How can I tell the model about those input & target to be trained on ?

2

Hi,

The T5 docs is quite extensive (it’s equivalent for mT5): T5.

Next to that, I do have some notebooks that illustrate how to fine-tune T5 models: Transformers-Tutorials/T5 at master · NielsRogge/Transformers-Tutorials · GitHub