How to get the loss history when use trainer.train()?

Beginners
1

I am using the huggingface transformers. I noticed that when I call the train(), I can get a table contains the evaluation loss and training loss, how can I get the data in this table and use them to plot figures? (without wandb)

Screenshot from 2022-05-04 01-36-42
Screenshot from 2022-05-04 01-36-421207×784 75.6 KB

2

You should find them in Trainer.state.log_history. There is a parse_log_history function in the modelcard module that might be helpful to clean those logs.

2 Likes
3

Thank you !! I got it !!!

4

Can you please share how to do it?

5

Suppose you initialized:

trainer = transformers.Trainer(...)

Then you can access and convert the losses to dataframe by running

import pandas as pd
pd.DataFrame(trainer.state.log_history)
2 Likes