I am trying to fine tune a T5 model using xsum dataset but I am getting the following. Should I just change the sames “summary, document and id” to something else? Or that’s due to something else?
The following columns in the training set don’t have a corresponding argument in T5ForConditionalGeneration.forward and have been ignored: summary, document, id.
The Trainer automatically ignores columns in your dataset which aren’t used by the model. For T5 for instance, the model expects input_ids, attention_mask, labels etc., but not “summary”, “document”, “id”. As long as input_ids etc are in your dataset, it’s fine.
The warning is just telling you that those columns aren’t used.