I want to pre train a t5 model for question answer task with own dataset.The dataset contain 10 question answer for each paragraph.How to give input to the t5 model.
If you have 10 question and answer pairs for each context, Your input structure should be
source_text->context
target_text->QA pairs separated by any tokens , for example → [SEP] like that