Zero shot classification score


I have hierarchical taxonomy and text segments. I have tried to use zero-shot classifier for child categories and for parents separately. I have problem with scores, always the first label takes the highest one. Could you give me some advice how. can I fix it? Or should I use other classifiers or methods?