Unable to Deploy Hugging Face Endpoint on Azure

I am trying to deploy a model to the Azure endpoint (Hugging Face on Azure – Huggingface Transformers | Microsoft Azure) but it is failing with the following error:

The resource provider ‘public’ received a non-success response ‘InternalServerError’ from the downstream endpoint for the request ‘PUT’ on ‘HuggingFace.Endpoint/0ff1352f-e431-xxxxxxxxxxx’. Please refer to additional info for details.

Am I missing anything?

1 Like

+1. I have the same problem as OP. Below is a subset of your RP, HuggingFace.Endpoint, error (without any PII info):

{
    "authorization": {
        "action": "Microsoft.CustomProviders/resourceProviders/HuggingFace.Endpoint/write",
    },
    "correlationId": "2ea193d7-cf13-4399-93fb-4b6ff3fd5199",
    "description": "",
    "eventDataId": "8c45ad42-b405-40fd-b409-ccb10944dce4",
    "eventName": {
        "value": "EndRequest",
        "localizedValue": "End request"
    },
    "status": {
        "value": "Failed",
        "localizedValue": "Failed"
    },
    "subStatus": {
        "value": "InternalServerError",
        "localizedValue": "Internal Server Error (HTTP Status Code: 500)"
    },
    "submissionTimestamp": "2022-11-10T01:31:42Z",
    "properties": {
        "statusCode": "InternalServerError",
        "serviceRequestId": null,
        "statusMessage": "{\"error\":{\"code\":\"DownstreamEndpointError\",\"message\":\"The resource provider 'public' received a non-success response 'InternalServerError' from the downstream endpoint for the request 'PUT' on 'HuggingFace.Endpoint/3b29529c-3cdb-4550-9cb1-2804c2115229'. Please refer to additional info for details.\"}}",
        "eventCategory": "Administrative",
        "entity": "/subscriptions/<>/resourceGroups/mrg-huggingface-20221104035846/providers/Microsoft.CustomProviders/resourceProviders/public/HuggingFace.Endpoint/<>",
        "message": "Microsoft.CustomProviders/resourceProviders/HuggingFace.Endpoint/write",
}

The Hugging Face AzureML Endpoints are currenlty only supporting transformers models and not diffusers