I seem to be encountering a sudden issue with the Hugging Face Inference API. I was successfully using it for image-to-image tasks (specifically with models like stabilityai/stable-diffusion-xl-refiner-1.0), but it abruptly stopped working a short while ago.
Now, regardless of which model I try to use, I consistently receive the following error pattern:
Model <model_name> is not supported HF inference api
This is happening in two distinct ways:
Via InferenceClient: My application code, which was previously working, now gets this error for any model inference request.
Via Website Inference Widget: Even trying to use the Inference Widget directly on the model pages on the Hugging Face website results in the same error message appearing where the widget interface should be.
Here are a couple of specific examples I’ve tested:
Output:Model stabilityai/stable-diffusion-xl-refiner-1.0 inference is not supported HF inference api (Note: I’ve tried several others with the same result)
Since this is affecting multiple models and occurs both through the API client and the website widget, it feels like it might be a broader issue rather than something specific to my setup or a single model.
Is anyone else experiencing similar behavior? Any information or confirmation would be greatly appreciated!
We are seeing 404 error on these two
{“error”:“Model nvidia/cycle-diffusion does not exist”} Status: 404
{“error”:“Model yisol/IDM-VTON inference is not supported HF inference api”} Status: 404
every request fails with:
‘Could not complete request to HuggingFace API, Status Code: 404, Error: Model (…) inference is not supported by HF inference API’.
It’s probably both. Since a renewal is being carried out that will eventually only allow the so-called Warm model to be used, it will ultimately be a battle for the entry slots, excluding the famous models.
Hello there. When I first noticed this happening a few days ago, I decided to check the models page to check and verify which models were still working and which gave errors despite being “deployed”, and I noticed that the biggest models are still working fine with zero issues. If you look at the models page at this very moment and set the filters for text-to-image and the HF inference provider, you will notice that a grand total of 6 models are still deployed and functional, compared to over 25,000 models that were “deployed” a few days ago. Either these models are just built differently to be unaffected, or HF staff has these models segregated on their own servers that are kept seperate and safe from any issue with inferences that crop up. If it is the second, then the companies that maintain the base models are either shilling out to HF staff, HF staff already pushed their updated inference API for these models, or this is a semi-blatant case of cherry picking which models that Huggingface will support, which is anti-user friendly at best, and blatantly greedy at worst. Also, @John6666, if you use your Diffusion Crafter spaces, the ones with the ZERO GPU, you would notice that your models, and any models loaded by that space, all work successfully for generating images, while obviously they fail for serverless generation. If this keeps up, I may have to just use https://www.mage.space/ for the foreseeable future (I am a long time subscriber to their pro membership, which at $15 a month is a little pricy, but let’s me enjoy over 200+ text-to-image models, some of which are exclusive to mage.space, with unlimited generations as well as a text-to-video and image-to-video model (the Hunyaun model, which is a beta feature currently). There is a much pricier $30 per month subscription whose only real benefit is the ability to upload custome models from your PC or from HF or Civitai. The only issues with the website is the overzealous, highly inconsistent safety checker which can trigger for one generation but allow another generation to complete perfectly fine).
It looks like the Inference API is having issues. Here are some steps to troubleshoot:
Check API Status: Verify if there’s an ongoing outage on the provider’s status page.
Review Logs: Look at your logs for error details that might point to the problem.
Retry: Sometimes, temporary disruptions happen. Try again after a few minutes.
Use Proxies: If you’re using the API for web scraping or data collection, consider using Thordata’s residential proxies. They can help bypass temporary blocks and keep your data flow uninterrupted.
Contact Support: If the issue persists, reach out to the provider’s support team.
If you’re using Thordata’s proxies, feel free to reach out for any help with configuring them or troubleshooting.
It looks like the Inference API is having issues. Here are some steps to troubleshoot:
Check API Status: Verify if there’s an ongoing outage on the provider’s status page.
Review Logs: Look at your logs for error details that might point to the problem.
Retry: Sometimes, temporary disruptions happen. Try again after a few minutes.
Use Proxies: If you’re using the API for web scraping or data collection, consider using Thordata’s residential proxies. They can help bypass temporary blocks and keep your data flow uninterrupted.
Contact Support: If the issue persists, reach out to the provider’s support team.
If you’re using Thordata’s proxies, feel free to reach out for any help with configuring them or troubleshooting.
Even for models that are still served I keep getting ‘Model is loading (503)’ error. 50% of my requests now error.
Tried joining the discord but the verification is broken. Anyone know of any alternative service providers?
I just checked the same but for image-to-image models (my personal use case), and there’s 0 models available. At this point this is making HF unusable, which really sucks, after having spent a lot of time developing with the Inference API in mind.
