Dear HF, I am trying to implement the stopping criteria list method on model.generate. The docs say to use the BERT tokeniser to generate the input ids, and the scores. However this is not the tokenizer associated with the OPT model. Should I be generating them with the OPT tokenizer or the BERT …

Stopping Criteria List - OPT model

Lyma October 14, 2022, 2:59pm 2

Hi!

Please, check my reply in the other question of yours: Implimentation of Stopping Criteria List - #2 by Lyma

Topic		Replies	Views
Implimentation of Stopping Criteria List Beginners	18	20540	April 8, 2024
Implementing StoppingCriteria for Code Generating Transformers 🤗Transformers	2	1574	January 4, 2024
How to set stopping criteria in model.generate() when a certain word appears 🤗Transformers	3	830	February 18, 2024
How to stop after generating "###" in transformers? Beginners	0	669	May 3, 2023
StoppingCriteria - do not include the last triggering token Intermediate	0	279	January 18, 2023