Constant 503 error for several days when running LLAMA 3.1

[John6666]

Depending on the model, it seems that this can be avoided by the following methods.

Inference API stopped working

Mine stopped for a while too getting 503: “503 Server Error: Service Temporarily Unavailable for url: https://router.huggingface.co/hf-inference/models/black-forest-labs/FLUX.1-schnell” I looked that you could set a provider. I changed the parameters to the following and it worked. from huggingface_hub import InferenceClient client = InferenceClient( provider="fal-ai", api_key="hf_xxxxxxxxxxxxxxxxxxxxxxxx", ) Which you can find if you click view code on the model card. Looks like …