Serverless Inference API error on new model

Inference Endpoints on the Hub
6

There were generally three problems that occurred with HF this time, limited to the image generation AI,

  1. Errors that prevented the use of the Serverless Inference API, regardless of the client (can be fixed manually by following the instructions below, and new occurrences are almost never seen).
  2. An error that caused very strange server-side responses on some Gradio 3.x systems (still ongoing, no workaround, but spaces that have not been restarted after the problem are safe).
  3. Multiple fatal errors in Zero GPU space (the biggest one was fixed a few days ago but still remains)

Workaround

Setting fastapi==0.112.2 in requirements has helped me as a temporary fix.

We just released gradio==4.43 with the same fix. So new Gradio Spaces should work fine now (older ones will need to update the sdk_version in the README.md file)

Workaround in Zero GPU Space

Long shit report by me.