I like to change the number of labels that a trained model has. I am loading a model that was trained on 17 classes and I like adapt this model to my own task. Now if I simply change the number of labels like this:
model_checkpoint ="vblagoje/bert-english-uncased-finetuned-pos" model = AutoModelForTokenClassification.from_pretrained(model_checkpoint,num_labels=2)
I get an error saying:
RuntimeError: Error(s) in loading state_dict for BertForTokenClassification: size mismatch for classifier.weight: copying a param with shape torch.Size([17, 768]) from checkpoint, the shape in current model is torch.Size([2, 768]). size mismatch for classifier.bias: copying a param with shape torch.Size() from checkpoint, the shape in current model is torch.Size().
My question is: How do I replace the classification head?
Thanks a lot