>>> generator = pipeline("text-generation", model="HuggingFaceTB/SmolLM2-360M") config.json: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 689/689…

With the current Transformers library code, max_new_tokens takes precedence over max_length , so specifying max_new_tokens is the simplest approach.

Setting max_length does not limit length of output

system Closed August 27, 2025, 3:21pm 3

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Pipeline max_length 🤗Transformers	2	3965	February 23, 2024
How to set 'max_length' properly when using pipeline? 🤗Transformers	4	1749	November 18, 2024
How to change max_length of a fine tuned model 🤗Transformers	4	11537	May 11, 2024
Output token lengths of smaller models 🤗Transformers	0	505	October 30, 2023
Confused about max_length and max_new_tokens 🤗Transformers	7	36668	September 5, 2024