huggingface_hub.utils._errors.HfHubHTTPError: 404 Client Error: Not Found for url:

[HuggingFaceSar23Ts]

When I am using –

model = HuggingFaceHub(
repo_id=“bigscience/bloomz-560m”,
model_kwargs={
“temperature”: 0.7,
“max_new_tokens”: 100
}
)

Infrence API via hugging face it through the error

huggingface_hub.utils._errors.HfHubHTTPError: 404 Client Error: Not Found for url: https://api-inference.huggingface.co/models/bigscience/bloomz-560m

If anyone have face same kind of problem kindly help me out ASAP thankyou

[John6666]

For langchain, try this:

Facing issue using a model hosted on HuggingFace Server and talking to it using API_KEY

pip install langchain-huggingface langchain from langchain_huggingface import ChatHuggingFace, HuggingFaceEndpoint llm = HuggingFaceEndpoint( repo_id="deepseek-ai/DeepSeek-R1", provider="together" ) model = ChatHuggingFace(llm=llm) result = model.invoke("What is the capital of India") This works for me with the following setup: $ pip freeze | grep huggingface huggingface-hub==0.31.1 langchain-huggingface==0.2.0 $ pip freeze | grep langchain langchain==0.3.25 langchain-core==0.3.59 langcha…