Inference endpoint

Hi guys, I have been trying to find a way on how to use one of the top embedding models from MTEB leaderboard. Since I dont have enough gpu memory I decided to use HF inference endpoints. However I found only the high level tasks such as classification, sentence similarity etc. (🤗 Hugging Face Inference Endpoints)

What I actually need is to obtain the embedding vectors themselves to store them in my local vector db. Is there a way to do it using inference endpoints? If not do you has some suggestions on where to run the model in order to get the embedding vectors for given text?

Thanks and cheers

1 Like

Solved:

One needs to use a model set up for feature-extraction