Good day, I’m generating text with run_generation.py. I would like to know if there is any way to pass the attribute no_repeat_ngram_size. I have seen that attribute with model. generate but not in run_generation.py.

Does run_generation.py has a "no_repeat_ngram_size" attribute?

valhalla September 3, 2020, 4:13am 4

Thanks @yjernite! Didn’t know that no_repeat_ngram_size can also be used with sampling.

Topic	Replies	Views
Text Generation Returns Repeat or Random Beginners	499	August 24, 2023
Confused by description: encoder_no_repeat_ngram_size 🤗Transformers	783	November 1, 2021
Prevent repeat tokens in GPT2LMHeadModel text generation with max_new_tokens=1 Beginners	1102	November 19, 2021
How to provide "negative topics" for OPTForCausalLM? 🤗Transformers	217	November 26, 2022
Where to set the batch size for text generation? Beginners	1064	September 17, 2022