I’m tryting to get stats of the inference time of different code-completion models on the HumanEval dataset. Since timing is a crucial part of this project, I don’t want to time the model when it generates irrelevant tokens. Thus, I hope to implement StoppingCriteria on the code-completion models, n…

Implementing StoppingCriteria for Code Generating Transformers

Pissarra January 4, 2024, 9:39am 2

It might help you

Regards

Nuno

1 Like