Add a classification head to a fine-tuned language model

You need to use the AutoModelForSequenceClassification class to add a classification head on top of your pretrained model.