Problem generating with T5ForConditionalGeneration on a custom task

[John6666]

There seems to have been a problem with the output of T5 in a newer version of Transformers a while ago, so if it’s related to that, it’s easy…

transformers 4.41.0 breaks generate() for T5

Unable to use model.generate for Vision encoder decoder model

Here is my model configuration from transformers import ViTImageProcessor, BertTokenizer, VisionEncoderDecoderModel from datasets import load_dataset model = VisionEncoderDecoderModel.from_encoder_decoder_pretrained( "google/vit-base-patch16-224-in21k", "google-bert/bert-base-uncased" ) image_processor = ViTImageProcessor.from_pretrained("google/vit-base-patch16-224-in21k") tokenizer = BertTokenizer.from_pretrained("google-bert/bert-base-uncased") model.config.decoder_start_token_id = to…