[image] T5 — transformers 3.1.0 documentation I have been reading the documentation for the T5 model and in the training section, for both unsupervised denoising and supervised training, the comment states the model is able to create the correct decoder_input_ids.…

How does T5 create the correct decoder_input_ids?

lintang September 21, 2020, 1:30pm 3

Thanks for pointing this out for me!

Topic		Replies	Views
T5 models: About the decoder_input_ids argument Models	0	761	December 5, 2022
The meaning of 'decoder input ids' in encoder-decoder model Beginners	1	2397	July 29, 2022
What is the correct form of decoder_input_ids for LEDForConditionalGeneration? 🤗Transformers	1	711	July 5, 2021
Is there a way to return the "decoder_input_ids" from "tokenizer.prepare_seq2seq_batch"? 🤗Transformers	5	3350	December 29, 2020
T5 fine tuning, loss difference when using labels and decoder_input_ids 🤗Transformers	2	1177	October 12, 2020