I have finished training my BERT model from scratch after calling
Next, I want to evaluate my val set and get val loss by calling
trainer.evaluate() but I have received this error
TypeError: full_like() got an unexpected keyword argument 'shape'
I couldn’t find much information about this error or a solution to fix it. If anyone could give me a suggestion it would be highly appreciated.
Here is the full code of my Trainer and Training arguments:
from transformers import Trainer, TrainingArguments
training_args = TrainingArguments( output_dir="./bertmodel", overwrite_output_dir=True, num_train_epochs=5, per_device_train_batch_size=32, per_device_eval_batch_size=32, save_steps=10000, save_total_limit=2, do_train=True, do_eval=True, logging_steps=700, eval_steps = None, prediction_loss_only=True, ) trainer = Trainer( model=model, args=training_args, data_collator=data_collator, train_dataset=train_dataset, eval_dataset=eval_dataset, )