I am trying to deploy a model to the Azure endpoint (Hugging Face on Azure – Huggingface Transformers | Microsoft Azure) but it is failing with the following error:
The resource provider ‘public’ received a non-success response ‘InternalServerError’ from the downstream endpoint for the request ‘PUT’ on ‘HuggingFace.Endpoint/0ff1352f-e431-xxxxxxxxxxx’. Please refer to additional info for details.
Am I missing anything?
+1. I have the same problem as OP. Below is a subset of your RP, HuggingFace.Endpoint, error (without any PII info):
{
"authorization": {
"action": "Microsoft.CustomProviders/resourceProviders/HuggingFace.Endpoint/write",
},
"correlationId": "2ea193d7-cf13-4399-93fb-4b6ff3fd5199",
"description": "",
"eventDataId": "8c45ad42-b405-40fd-b409-ccb10944dce4",
"eventName": {
"value": "EndRequest",
"localizedValue": "End request"
},
"status": {
"value": "Failed",
"localizedValue": "Failed"
},
"subStatus": {
"value": "InternalServerError",
"localizedValue": "Internal Server Error (HTTP Status Code: 500)"
},
"submissionTimestamp": "2022-11-10T01:31:42Z",
"properties": {
"statusCode": "InternalServerError",
"serviceRequestId": null,
"statusMessage": "{\"error\":{\"code\":\"DownstreamEndpointError\",\"message\":\"The resource provider 'public' received a non-success response 'InternalServerError' from the downstream endpoint for the request 'PUT' on 'HuggingFace.Endpoint/3b29529c-3cdb-4550-9cb1-2804c2115229'. Please refer to additional info for details.\"}}",
"eventCategory": "Administrative",
"entity": "/subscriptions/<>/resourceGroups/mrg-huggingface-20221104035846/providers/Microsoft.CustomProviders/resourceProviders/public/HuggingFace.Endpoint/<>",
"message": "Microsoft.CustomProviders/resourceProviders/HuggingFace.Endpoint/write",
}
The Hugging Face AzureML Endpoints are currenlty only supporting transformers models and not diffusers
Hello @philschmid! I’m trying to deploy a whisper model https://huggingface.co/openai/whisper-tiny. Is it also not supported? The error that I get is:
“The resource provider ‘public’ received a non-success response ‘InternalServerError’ from the downstream endpoint for the request ‘GET’ on ‘HuggingFace.Endpoint/whisper-tiny-91mt3qoi’. Please refer to additional info for details.”
Hello @Charalampos,
AzureML Endpoints are currently only supporting NLP models. But you could easily deploy Whsiper with our SaaS solution Inference Endpoints: See: Managed Transcription with OpenAI Whisper and Hugging Face Inference Endpoints