Hello, I am using beam search with a pre-trained T5 model for summarization. I would like to visualize the beam search process by showing the tokens with the highest scores, and eventually the chosen beam like this diagram: [image] (Taken from How to generate text: using different decoding metho…

Showing individual token and corresponding score during beam search

monmanuela February 21, 2021, 7:25am 2

Tagging @patrickvonplaten reposted my question from Github, thanks for directing me to the forum

Perplexity for BART summaries

Topic		Replies	Views
T5 transformer tokens and scores Beginners	0	611	July 26, 2022
Generation scores Beginners	0	418	April 24, 2023
Retrieving Probability Over Tokens During Beam Search 🤗Transformers	0	441	August 3, 2022
Beam_search and generate are not consistent 🤗Transformers	0	385	May 10, 2022
T5: why do we have more tokens expressed via cross attentions than the decoded sequence? Intermediate	1	307	February 21, 2023