GETTING ERROR >> AttributeError: 'InferenceClient' object has no attribute 'post'

🤗Transformers
1

HI ALL , BELOW IS MY CODE:

from langchain.llms import HuggingFaceHub

from langchain import PromptTemplate, LLMChain

repo_id=“mistralai/Mistral-7B-Instruct-v0.2”

response=llm.invoke(“what is the capital of USA”)

print(response)

ERROR BELOW:
AttributeError: ‘InferenceClient’ object has no attribute ‘post’

image
image1423×643 61.5 KB

1 Like
2

Ongoing issue.

Solution for SentenceTransformers:

3

ANY SOLUTION GUYS ??

KINDLY PLEASE PROVIDE THE SOLUTION

image
image1423×643 61.5 KB

1 Like
4

Hmm… For example, for langchain: I am getting this error on langchain

5

same

Screenshot 2025-05-26 at 23.59.09
Screenshot 2025-05-26 at 23.59.092874×1240 394 KB

1 Like
6

Hmm… It seems that this cannot be resolved with a user patch…
I think you need to raise an issue to resolve this.

7

STILL NO SOLUTION OVER THIS ???

KINDLY RESOLVE: AttributeError: ‘InferenceClient’ object has no attribute ‘post’

3 Likes
8

Seems WIP?

It may be possible to fix this on the langchain side, but I don’t think it has been done yet.

9

You’re using InferenceClient which doesn’t have a .post() method. LangChain expects HuggingFaceHub for this to work.

Swap it to:

from langchain.llms import HuggingFaceHub
llm = HuggingFaceHub(repo_id=“mistralai/Mistral-7B-Instruct-v0.2”, huggingfacehub_api_token=“your_token”)

That’ll stop the .post() error.

Solution provided by Triskel Data Deterministic AI

1 Like
10

your solution is NOT WORKING

1 Like
12

Dear Respected Brother, I never degenerated your solution… When I ran your code on colab, its showing Bugs or error…
I mean no offense … Please kindly run your solution first and check whether its working before passing it online…

Good day bro

2 Likes
13

I also wasted lot of time for this… I wastrying a lot and found everyone is struggling with the same issue.

1 Like
14

Me too going with the same error
AttributeError: ‘InferenceClient’ object has no attribute ‘post’
the code snippet is shared below
from langchain import HuggingFaceHub, LLMChain
from langchain.prompts import PromptTemplate
os.environ[“HF_TOKEN”] = “my_token”

llm=HuggingFaceHub(repo_id=“mistralai/Mistral-7B-Instruct-v0.2”)

prompt = PromptTemplate(
input_variables=[“product”],
template=“What is the best name for startup of {product}?”
)

chain= LLMChain(prompt=prompt,llm=llm,verbose=True)
print(chain.run(“camera”))

2 Likes
15

image
image1438×721 40.6 KB

Can anyone help me with this issue?

1 Like
16

Use below code: This will resolve and you can prompt:

repo_id=“mistralai/Mistral-7B-Instruct-v0.3”

llm = HuggingFaceEndpoint(
repo_id=repo_id,
max_new_tokens=512,
top_k=10,
top_p=0.95,
typical_p=0.95,
temperature=0.01,
repetition_penalty=1.03,
huggingfacehub_api_token=sec_key
)

print(llm.invoke("write a poem on deep learning , for children age 10 "))

1 Like
17

image
image1172×713 33.8 KB

There is an issue with HuggingFaceEndpoint package

#from langchain_huggingface import HuggingFaceEndpoint
from langchain_community.llms import HuggingFaceEndpoint
from langchain import PromptTemplate, LLMChain
import os

repo_id="mistralai/Mistral-7B-Instruct-v0.3"

llm = HuggingFaceEndpoint(
    repo_id=repo_id,
    max_new_tokens=512,
    top_k=10,
    top_p=0.95,
    typical_p=0.95,
    temperature=0.01,
    repetition_penalty=1.03,
    huggingfacehub_api_token="hf_*****"
)

print(llm.invoke("write a poem on deep learning , for children age 10 "))
1 Like
18

Even I am facing the same issue:

image
image1062×763 40.6 KB

1 Like
19

InferenceClient.post has been completely deprecated, so I think that older library implementations that call it will not work.
We need to find a way to avoid this.