E5 embedding models

John6666 · March 17, 2025, 4:54pm

I wonder if the model is for SentenceTransformer rather than Transformers, so it’s different in terms of usability.

The project of E5: How to fine-tune on the E5 model?

opened 07:26AM - 14 Apr 23 UTC

closed 09:51AM - 08 May 23 UTC

Dear author: The following informations is about the paper and project of E5: […Text Embeddings by Weakly-Supervised Contrastive Pre-training](https://arxiv.org/pdf/2212.03533.pdf). Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang, Rangan Majumder, Furu Wei, arXiv 2022 I want to fine-tune on my dataset. However, I do not know how to do it, there is no more information on the main site of GitHub: https://github.com/microsoft/unilm/tree/master/e5. 1. I don't know how to prepare my data. Same as what is the data structure should I design. 2. What the tools should I use? Can you provide more information or train_script / finetune_script on the GitHub . Thank you very much.

Topic		Replies	Views
Embedding Model Fine Tuning Spaces	2	40	May 8, 2025
How to get sentence embedding using a fine-tuned model Intermediate	0	263	April 18, 2023
Fine-tuning a language model on domain specific embeddings 🤗Transformers	1	1138	November 21, 2023
Unsup fine tuning embeddings 🤗Transformers	0	412	June 21, 2023
Train the Best Sentence Embedding Model Ever with 1B Training Pairs Flax/JAX Projects	36	26012	July 2, 2023

E5 embedding models

Related topics