Fine tune pretrained model

I have question regarding fine tune pretrained model, let’s say model predicted classifcation as Neutral, can i change classified value to Positive (will use smaller dataset to overwrite values) and fine tune that model?

I would like keep most of the pretrained prediction which was good but only few cases would like to overwrite.