Evaluating Finetuned BERT Model for Sequence Classification

If you want other metrics, you have to indicate that to the Trainer by passing a compute_metrics function. See for instance our official GLUE example or the corresponding notebook.