How is loss and eval_loss calculated?

harshit-ranjan February 26, 2024, 11:14am 1

Hi,
I am trying to finetune Salesforce/codet5p-770m on MBPP dataset.
I am using the Seq2SeqTrainer class for this.
I want to know how the loss and eval_loss after every epoch are calculated.

Topic		Replies	Views
Run_mlm.py: Why does eval_loss at the last epoch differ from the do_eval eval_loss? Beginners	2	775	March 18, 2021
Eval Loss spike Seq2seq Trainer Resume from Checkpoint 🤗Transformers	0	507	June 22, 2021
How do i get Training and Validation Loss during fine tuning 🤗Transformers	2	13745	August 27, 2021
Loss to zero in the training Models	0	2056	February 17, 2022
Using Trainer class with T5 - what is returned in EvalPrediction dict? 🤗Transformers	8	5125	February 14, 2022

How is loss and eval_loss calculated?

Related topics