Is sentence-transformers supported?

HF Endpoints on Azure
#1

Hi,

I am trying to load sentence-transformers/all-MiniLM-L6-v2 as an Azure HF Endpoint, getting an error

“Failed to create HuggingFace.Endpoint resource ‘…’ in ‘…’. Error: The resource provider ‘public’ received a non-success response ‘InternalServerError’ from the downstream endpoint for the request ‘PUT’ on ‘HuggingFace.Endpoint/…’. Please refer to additional info for details”

whereas another popular model deployed successfully. Could there be another reason for this error?

Thanks!

#2

Are you referring to: sentence-transformers/all-MiniLM-L6-v2 · Hugging Face. This model has the task „Sentence Similarity“ which is not yet supported on the AzureML Endpoints as a quick turnaround you can take a look at Hugging Face Inference Endpoints, where we support all sentence transformers tasks.