Probing fine-tuned model

thak123 · December 1, 2020, 3:59pm

Any tools to see how the model weighs the various words/pieces in the input for the predictions.

rgwatwormhill · December 3, 2020, 11:20am

hi thak123,

If you are using BERT model in PyTorch, then BertViz by Jesse Vig is quite nice.

Topic		Replies	Views
Optimal methods to monitor attention matrices when doing training/inference using BERT-type models Intermediate	2	561	September 11, 2021
How to test saved fine tuned bert model? Beginners	0	447	November 28, 2023
Inference from a fine-tuned model -- help with interpretation of results Beginners	3	205	January 26, 2024
Loading pytorch_pretrained_bert models with transformers Beginners	2	1624	April 29, 2021
Custom Tasks and BERT Fine Tuning Beginners	4	4521	October 30, 2020