Hi, I am using the Trainer API to train a custom Transformer model on a new language. During evaluation I would like to see the bits per character (BPC) instead of the eval_loss and perplexity. I was wondering how I would go about doing this using the Trainer API?
1 Like