By doing above, it is still not picking the weights properly. Can you share any reference where examples of inheriting PreTrainedModel is used to create custom model? And how to re-load it with from_pretrained?
By doing above, it is still not picking the weights properly. Can you share any reference where examples of inheriting PreTrainedModel is used to create custom model? And how to re-load it with from_pretrained?