Hi there, I wanted to create a custom model that includes a transformer and save it using the save_pretrained function after training for a few epochs. I would then want to load it in a different notebook using the from_pretrained function for inference. Suppose I follow this guide and created a c…

Yes you can inherit from PreTrainedModel to inherit methods like from_pretrained, save_pretrained and push_to_hub. Alternatively, you can leverage the PyTorchModelHubMixin class available in the huggingface_hub library. This allows you to get the same functionality: from torch import nn from huggi…

How to load a pretrained custom model using `from_pretrained`

Beginners

nomorewords February 6, 2023, 2:16pm 3

Thank you, this is exactly what I was looking for!

Topic		Replies	Views
How to save and load fine-tune model 🤗Transformers	4	24660	October 25, 2021
Saving/Loading custom model build from varying HF models Intermediate	1	1346	March 20, 2023
Save custom transformer as PreTrainedModel Intermediate	1	924	September 7, 2021
Elegant way to load and save a pretrained model as part of other model? 🤗Transformers	0	849	June 9, 2022
Create a custom model that works with any pretrained transformer body Beginners	2	1230	May 16, 2025

How to load a pretrained custom model using `from_pretrained`

Related topics