Model weights warning while loading any model from HuggingFace models

This warns you that some of the model weights have not been found in the checkpoint, and that there were therefore randomly initialized. This is because you are loading a model trained for masked language modeling (bert-base-cased) in a model for sequence classification, the classification head is randomly initialized.

The warnings ends by telling you that your model needs to be trained because of that random initialization.

1 Like