Metrics in Comet.ml from Transformers

Hello, I am using Comet.ml to log my transformer training. For the puposes of logging confusion matrix, i am not able to use CometCallback because it become practically impossible to then calculate these matrices.

Due to this, i am getting very different interpretation of steps. While my output shows, total optimization steps = 3512 and my comet log records steps in 20k steps in it’s graph.

I am confused. what is being logged, and what loss is being logged? or in optimizer case, which loss is being logged.

I think we have these questions answered over here: Comet and Transformers · Issue #434 · comet-ml/issue-tracking · GitHub

1 Like