I tried look into this similar issue: Custom GPT2 Model won't load after training but still… class CustomClass(PreTrainedModel): def __init__(self, config, num_labels): super().__init__(config, num_labels) self.distilbert = DistilBertModel.from_pretrained('distilbert-base-uncas…

Load Custom Model

sgugger November 21, 2021, 2:13pm 2

You should use CustomClass.from_pretrained. PreTrainedModel.from_pretrained won’t work directly.

Topic		Replies	Views
How to load a pretrained custom model using `from_pretrained` Beginners	4	7554	June 21, 2023
Custom GPT2 Model won't load after training Intermediate	1	1173	September 15, 2021
Custom PretrainedModel does not loaded correctly Beginners	0	279	November 17, 2022
Saving/Loading custom model build from varying HF models Intermediate	1	1378	March 20, 2023
Error loading custom model Beginners	0	19	March 11, 2025