I have a pretrained T5 model that predicts the solution to quadratic equations and I want to use bertviz library for visualizing attention. In all the examples I found the length of the input and output are the same, but in my case they are different. tokenizer = PreTrainedTokenizerFast.from_pretra…

Hi, what’s going on here is that when you get back the attentions from a generate call, you’re getting back a tuple of attentions for each token you generated, so that’s what the outer tuple is for. Meanwhile, the inner tuples are for each layer of the model. For example if you run: from transform…

Error when trying to visualize attention in T5 model

Beginners

snork-maiden March 20, 2024, 8:28am 5

Hello @rr-7 here is part of my notebook where I do visualization.

Hope this helps.

Topic		Replies	Views
What is the dimensionality of output_attentions? 🤗Transformers	0	474	July 9, 2022
Attention and hidden state details from t5 Beginners	0	194	November 12, 2020
Understanding attention output from generate method in GPT model Beginners	0	637	November 8, 2023
Probing fine-tuned model Beginners	1	928	December 3, 2020
Undestarding output_attentions= True 🤗Transformers	0	201	November 25, 2023

Error when trying to visualize attention in T5 model

Related topics