Facing issue building a simple RAG application using RetrievalQA

[John6666]

tiiuae/falcon-7b-instruct · Hugging Face

The format of repo_id is correct, but since the model has not been deployed, it cannot be used as an API. Refer to the following post to find a model that can be used. Using a local model is more reliable, but requires a GPU.

Persistent 404 Not Found Errors with Public Inference API

Hi all, thanks for reporting! You can check to see if your model is available to use with the HF Inference API (or any Inference Provider) here: Models - Hugging Face. If it’s not deployed by any Inference Provider, you can request provider support on the model page. Please note Inference Endpoints is available to use - more info here: Inference Endpoints. Thanks!