I have problems finetuning T5 on text classification task.
I have 10 labels, but only 3 labels have training data. I finetune the T5 model on the training data(only 3 labels), then I validate it on the rest 7 labels. The perfomance is worse than the zeroshot result of
unfinetuned T5. So I am confused that if I finetune T5, will the model lose the zeroshot ability?