How to set stopping criteria in model.generate() when a certain word appears The word I need to stop the generation when found is : [/SENTENCE] But the model doesn’t generate the word itself, instead, it generates the subwords [ [/,SEN,TE,NC,E] ] like this. corresponding IDs from the tokenizer …

How to set stopping criteria in model.generate() when a certain word appears

berkecr February 18, 2024, 11:01am 4

@Pradeep1995 this may be a good solution.

1 Like

Topic		Replies	Views
Generate function and stopping criteria - stop when generated entire word (continue if subtoken merely part of word) Beginners	0	2114	March 3, 2023
Ensure sentence completion at "." 🤗Transformers	0	645	March 31, 2023
Implimentation of Stopping Criteria List Beginners	24	29503	January 24, 2025
Stopping criteria BLOOM Models	2	1654	December 9, 2022
StoppingCriteria - do not include the last triggering token Intermediate	0	330	January 18, 2023