Hello, I am trying to run this embedding model “sentence-transformers/LaBSE” with revision=“836121a0533e5664b21c7aacc5d22951f2b8b25b” on the Inference Endpoints. I have a result, but the embeddings numbers are different from the local execution. And not even correlated using cosine similarity. An…

Hi rpelissier :waving_hand: Sorry about the hassle here. I did a deep dive on issue and I think I know what’s going on: the model deployed in your inference endpoint uses the TEI server engine . Whereas the local example uses sentence-transformers. And unfortunately there’s a mismatch between the im…

Inference result not aligned with local version of same model and revision

Inference Endpoints on the Hub

system Closed June 27, 2025, 8:24am 16

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Can one get embeddings from an inference API that computes Sentence Similarity (in 2023)? Inference Endpoints on the Hub	0	418	June 3, 2023
Integration Issue with Finetuned Embedding Inference Endpoint Inference Endpoints on the Hub	0	45	November 18, 2024
Can one get an embeddings from an inference API that computes Sentence Similarity? Beginners	9	5332	March 13, 2025
Return embeddings via inference api 🤗Transformers	0	371	January 17, 2023
Inference endpoint Intermediate	1	32	August 11, 2024

Inference result not aligned with local version of same model and revision

Related topics