Subject: Consistent 404 Not Found Error with Inference API

Hello,

I am consistently receiving a 404 Not Found error when trying to use the Inference API, and I suspect there may be an issue with my account’s access.

  • I have tried multiple popular models (e.g., google/gemma-2b-it, mistralai/Mistral-7B-Instruct-v0.2) and they all fail with the same error.

  • I have confirmed the issue is not with my code, because a direct curl request also fails with a 404 Not Found error.

  • I have generated several brand new read tokens to ensure the key is valid, but they all result in the same error.

Could you please check if my account is properly enabled for Inference API access? Thank you.

1 Like

That model is currently not deployed. Also, the Inference API has changed, so the implementation needs to be reviewed.