Any tools to see how the model weighs the various words/pieces in the input for the predictions.

Probing fine-tuned model

rgwatwormhill December 3, 2020, 11:20am 2

hi thak123,

If you are using BERT model in PyTorch, then BertViz by Jesse Vig is quite nice.

1 Like

Topic		Replies	Views
How to visualize attention of a large encoder-decoder transformer model that isn't a model on hugging face? 🤗Transformers	0	2332	June 28, 2021
Optimal methods to monitor attention matrices when doing training/inference using BERT-type models Intermediate	2	718	September 11, 2021
Model visible in Exbert Models	1	354	February 20, 2022
Transformers Attention Viz - Visualizing Cross-Modal Attention in CLIP/BLIP Models Show and Tell	0	39	July 21, 2025
Replace weights in TFBertModel 🤗Transformers	1	2085	December 4, 2021