Stopping Criteria List - OPT model

Beginners
1

Dear HF,

I am trying to implement the stopping criteria list method on model.generate.

The docs say to use the BERT tokeniser to generate the input ids, and the scores. However this is not the tokenizer associated with the OPT model.

Should I be generating them with the OPT tokenizer or the BERT one?

2

Hi!

Please, check my reply in the other question of yours: Implimentation of Stopping Criteria List - #2 by Lyma