Hello, I am using beam search with a pre-trained T5 model for summarization. I would like to visualize the beam search process by showing the tokens with the highest scores, and eventually the chosen beam like this diagram: [image] (Taken from How to generate text: using different decoding metho…

Showing individual token and corresponding score during beam search

monmanuela February 21, 2021, 7:25am 2

Tagging @patrickvonplaten reposted my question from Github, thanks for directing me to the forum

Perplexity for BART summaries

Topic		Replies	Views
T5 transformer tokens and scores Beginners	0	706	July 26, 2022
[Announcement] GenerationOutputs: Scores, Attentions and Hidden States now available as outputs to generate 🤗Transformers	1	4560	January 13, 2021
Generation scores Beginners	0	595	April 24, 2023
Retrieving Probability Over Tokens During Beam Search 🤗Transformers	0	537	August 3, 2022
Beam_search and generate are not consistent 🤗Transformers	0	490	May 10, 2022