How to convert natural languages into vec?

🤗Transformers
1

I want to use a trained Transformers/ other model to convert natural language into a vec and I hope the similar meaning sentences could be converted into similar vecs;
Shall I get some advice for this?

2

I think you’re looking for embedding models.
A good place to start is the MTEB leaderboard.
Some of the entries on the leaderboard are closed source (like the embedding models from OpenAI) but a lot of them are also up on HuggingFace.

3

Hi Chahnwoo,
Thanks for your advice and I would check it carefully.

1 Like