Tokens in vector space

I wanted to see the correlation among the various classes I have for multi-class classification problem. The problem has 1 feature containing text and 1 target containing categories. There are 5 categories representing the kind of text. I want to see if there is any correlation between these 5 categories. How can I see that? As far I know for correlation between two entities we need to have one single number/vector representing each entity. However, here the entities are explained via text. I have used BERT Tokenizer to convert the text into tokens(later tensors).

Could you please provide some ideas?

Thanks and Regards,
Jyoti Rawat