Should I normalize SentenceTransformers embeddings?

Beginners
1

I’m trying to group text in Spanish based on their semantic similarity, I’m using SentenceTransformer to obtain the embeddings for my texts but I have a couple of questions:

  1. Neither of the models I’m currently using (hiiamsid/sentence_similarity_spanish_es and sentence-transformers/distiluse-base-multilingual-cased-v1) are normalized, SentenceTransformer gives me the option to normalize the embeddings, is there any reason to this?

  2. Is there any difference in terms of performance between the cosine similarity and the dot score?

  3. Why are some models normalized and others are not?