Inference result not aligned with local version of same model and revision

Hi rpelissier,

I totally understand and agree that it’s a serious bug.

Also just as a heads up: if you deploy this model on your own infra with the text-embedding-inference server, you’ll have the same bug.

So when you deploy on your own infra make sure to use the sentence-transformer implementation so that the embeddings are correct :+1:

2 Likes