Trainer.save_pretrained(modeldir) AttributeError: 'Trainer' object has no attribute 'save_pretrained'

Beginners
1

I am trying to save a model during finetuning but I get this error ?

trainer, outdir = prepare_fine_tuning(PRE_TRAINED_MODEL_NAME, train_dataset, val_dataset, tokenizer, sigle, train_name, elt_train.name)

trainer.train()
trainer.evaluate()						
						
#trainer.save_model(modeldir)
trainer.save_pretrained(modeldir)
tokenizer.save_pretrained(modeldir)
					

 trainer.save_pretrained(modeldir)
AttributeError: 'Trainer' object has no attribute 'save_pretrained'

Transformers version 4.8.0

2

I don’t knoe where you read that code, but Trainer does not have a save_pretrained method. Checkout the documentaiton for a list of its methods!

1 Like
3

I got it in transformer/train.py too.Have you solved this problem?

4

You can use trainer.save_model("path_to_store_model_tokenizer")

Load for later use:

from transformers import AutoModelForTokenClassification

model = AutoModelForTokenClassification.from_pretrained("path_to_store_model_tokenizer")