How to set stopping criteria in model.generate() when a certain word appears The word I need to stop the generation when found is : [/SENTENCE] But the model doesn’t generate the word itself, instead, it generates the subwords [ [/,SEN,TE,NC,E] ] like this. corresponding IDs from the tokenizer …

How to set stopping criteria in model.generate() when a certain word appears

berkecr February 18, 2024, 11:01am 4

@Pradeep1995 this may be a good solution.

1 Like