Probing fine-tuned model

thak123 · December 1, 2020, 3:59pm

Any tools to see how the model weighs the various words/pieces in the input for the predictions.

rgwatwormhill · December 3, 2020, 11:20am

hi thak123,

If you are using BERT model in PyTorch, then BertViz by Jesse Vig is quite nice.

Topic		Replies	Views
How to visualize attention of a large encoder-decoder transformer model that isn't a model on hugging face? 🤗Transformers	0	2344	June 28, 2021
Optimal methods to monitor attention matrices when doing training/inference using BERT-type models Intermediate	2	727	September 11, 2021
Extracting attention weights of summarization model Intermediate	0	441	August 12, 2021
Model visible in Exbert Models	1	358	February 20, 2022
Replace weights in TFBertModel 🤗Transformers	1	2098	December 4, 2021