Eval Loss spike Seq2seq Trainer Resume from Checkpoint

[MillyXXX]

I ran Trainer.train(resume_from_checkpoint = True). The eval loss spiked from 1.x to 5.x, but training loss is decreasing consistently, any possible reasons for this? Thanks