The documentation states that it is possible to obtain scores with model.generate via return_dict_in_generate / output_scores. generation_output = model.generate(**inputs, return_dict_in_generate=True, output_scores=True) However, when I add one of these to my model.generate, like model.generate(…

Generate: How to output scores?

sgugger April 6, 2021, 1:14pm 2

Are you sure you are on the latest version of Transformers?

1 Like

Topic		Replies	Views
TFT5ForConditionalGeneration generate returns empty output_scores 🤗Transformers	1	393	October 28, 2024
BartForConditionalGeneration is erroneous either at .forward or at .generate 🤗Transformers	0	302	August 14, 2022
How to get 'sequences_scores' from 'scores' in 'generate()' method Beginners	6	6267	May 2, 2023
Scores in generate() Beginners	6	10557	May 26, 2023
[Announcement] GenerationOutputs: Scores, Attentions and Hidden States now available as outputs to generate 🤗Transformers	1	4616	January 13, 2021