Whenever I am generating text the input is included in the output. When the input is close to the maximum length the model barely produces any useful output. Information When using transformers.pipeline or transformers.from_pretrianed, the model is only generating the input, when the input is long…

Output Includes Input

EstebanSir November 19, 2021, 2:38pm 3

I have the same problem with GPTJ, did you manage to fix this?

Topic		Replies	Views
Output token lengths of smaller models 🤗Transformers	0	505	October 30, 2023
How to change max_length of a fine tuned model 🤗Transformers	4	11537	May 11, 2024
Pipeline max_length 🤗Transformers	2	3965	February 23, 2024
Setting max_length does not limit length of output Course	2	19	August 27, 2025
Model.generate generates way too long outputs 🤗Transformers	0	311	September 9, 2023