Hello, I am using beam search with a pre-trained T5 model for summarization. I would like to visualize the beam search process by showing the tokens with the highest scores, and eventually the chosen beam like this diagram: [image] (Taken from How to generate text: using different decoding metho…

Showing individual token and corresponding score during beam search

monmanuela February 21, 2021, 7:25am 2

Tagging @patrickvonplaten reposted my question from Github, thanks for directing me to the forum

Perplexity for BART summaries

Topic	Replies	Views
T5 transformer tokens and scores Beginners	709	July 26, 2022
Beam_search and generate are not consistent 🤗Transformers	501	May 10, 2022
How to get the scores of a certain beam 🤗Transformers	373	June 13, 2022
Retrieving Probability Over Tokens During Beam Search 🤗Transformers	542	August 3, 2022
Confidence score for beam search (`sequence_score` from `scores`) Beginners	956	August 9, 2021