Following the tutorial here. I’ve tried to adapt it to my dataset.
But, I’ve noticed that during evaluation the Seq2SeqTrainer
calls the compute_metrics
3
times.
The first time it passes the correct validation/test set, but the other 2
times I don’t know what the hell is passing or why is calling the compute_metrics
3
times?