Hello, I just started to work with transformers and transformer pre trained models. And I’m facing a strange behaviour with t5-base pre trained model. I want to translate a text from english to french and everything works fine until my truncation issue. Here is my current code sample : def tran…

T5 pretrained model truncate translation "large" text

sheoran95 March 16, 2023, 3:24am 3

Topic		Replies	Views
Use Pretrained T5 for Summarization Beginners	3	498	July 2, 2021
T5 tokenizer's post-processor is suboptimal for truncated sequences for seq2seq finetuning 🤗Transformers	0	254	July 5, 2023
Finetuning T5 for Summarisation - Poor results Intermediate	0	87	March 30, 2024
Training the t5 Beginners	4	853	August 16, 2022
Fine-tuning T5 for translation Beginners	0	952	November 9, 2021