training_args = TrainingArguments( output_dir='./results', # output directory num_train_epochs=3, # total # of training epochs per_device_train_batch_size=16, # batch size per device during training per_device_eval_batch_size=16, # batch size for evaluation logging…

Key Error 'loss' while fine tuning GPT-2 with the Trainer utility

sgugger December 17, 2020, 2:01pm 2

If you have this error, it’s probably because you are not passing any labels to your model. It’s hard to know for sure since you don’t explain how you built your dataset.

NSP + WWM raises error when training BertForPreTraining

Topic		Replies	Views
When i use 'transformers.TrainingArguments', i got loss errors 🤗AutoTrain	1	610	April 28, 2023
【Solved】How can I get loss by using trainer when training gpt2? Beginners	3	818	July 21, 2022
Specify Loss for Trainer / TrainingArguments 🤗Transformers	5	13990	October 5, 2021
Logs of training and validation loss Beginners	9	22661	May 18, 2023
How do i get Training and Validation Loss during fine tuning 🤗Transformers	2	11667	August 27, 2021

Key Error 'loss' while fine tuning GPT-2 with the Trainer utility

Related Topics