Is sentence-transformers supported?


I am trying to load sentence-transformers/all-MiniLM-L6-v2 as an Azure HF Endpoint, getting an error

“Failed to create HuggingFace.Endpoint resource ‘…’ in ‘…’. Error: The resource provider ‘public’ received a non-success response ‘InternalServerError’ from the downstream endpoint for the request ‘PUT’ on ‘HuggingFace.Endpoint/…’. Please refer to additional info for details”

whereas another popular model deployed successfully. Could there be another reason for this error?


Are you referring to: sentence-transformers/all-MiniLM-L6-v2 · Hugging Face. This model has the task „Sentence Similarity“ which is not yet supported on the AzureML Endpoints as a quick turnaround you can take a look at Hugging Face Inference Endpoints, where we support all sentence transformers tasks.