Inference API stopped working

Mine stopped for a while too getting 503:
“503 Server Error: Service Temporarily Unavailable for url: https://router.huggingface.co/hf-inference/models/black-forest-labs/FLUX.1-schnell

I looked that you could set a provider.
I changed the parameters to the following and it worked.

from huggingface_hub import InferenceClient

client = InferenceClient(
    provider="fal-ai",
    api_key="hf_xxxxxxxxxxxxxxxxxxxxxxxx",
)

Which you can find if you click view code on the model card.

Looks like maybe the router code is not functioning properly. I could only speculate but potential issue there.

1 Like