Fine-tuning for text clustering

Helloo! I am working on clustering text embeddings. Is unsupervised fine-tuning for text clustering possible? if yes, may you explain briefly how? If not, does fine-tuning on text classification ameliorates the performance of text clustering?

I would really appreciate your help :smiley: