Hello, I am trying to run this embedding model “sentence-transformers/LaBSE” with revision=“836121a0533e5664b21c7aacc5d22951f2b8b25b” on the Inference Endpoints. I have a result, but the embeddings numbers are different from the local execution. And not even correlated using cosine similarity. An…

Hi rpelissier :waving_hand: Sorry about the hassle here. I did a deep dive on issue and I think I know what’s going on: the model deployed in your inference endpoint uses the TEI server engine . Whereas the local example uses sentence-transformers. And unfortunately there’s a mismatch between the im…

Inference result not aligned with local version of same model and revision

Inference Endpoints on the Hub

John6666 June 25, 2025, 1:59pm 12

Thank you, erikkaum!

1 Like

Topic		Replies	Views
Can one get embeddings from an inference API that computes Sentence Similarity (in 2023)? Inference Endpoints on the Hub	0	417	June 3, 2023
Integration Issue with Finetuned Embedding Inference Endpoint Inference Endpoints on the Hub	0	45	November 18, 2024
Can one get an embeddings from an inference API that computes Sentence Similarity? Beginners	9	5332	March 13, 2025
Return embeddings via inference api 🤗Transformers	0	371	January 17, 2023
Inference endpoint Intermediate	1	32	August 11, 2024

Inference result not aligned with local version of same model and revision

Related topics