GETTING ERROR >> AttributeError: 'InferenceClient' object has no attribute 'post'

omsite45 · May 25, 2025, 6:32am

HI ALL , BELOW IS MY CODE:

from langchain.llms import HuggingFaceHub

from langchain import PromptTemplate, LLMChain

repo_id=“mistralai/Mistral-7B-Instruct-v0.2”

response=llm.invoke(“what is the capital of USA”)

print(response)

ERROR BELOW:
AttributeError: ‘InferenceClient’ object has no attribute ‘post’

John6666 · May 25, 2025, 7:26am

Ongoing issue.

github.com/huggingface/huggingface_hub

InferenceClient.post is deprecated, but Sentence Ranking tasks are not implemented

opened 04:58PM - 06 May 25 UTC

marr75

bug

### Describe the bug The InferenceClient API still does not support many of the… tasks that can be hosted at inference endpoints, but gives a deprecation warning when using `.post` to get around this. ### Reproduction ```python from huggingface_hub import InferenceClient, get_inference_endpoint import json # Get endpoint and create client MODEL_NAME = "YOUR_MODEL_NAME_OR_ENDPOINT_NAME" NAMESPACE = "YOUR_NAMESPACE" endpoint = get_inference_endpoint(MODEL_NAME, namespace=NAMESPACE) client = InferenceClient(endpoint.url, timeout=10) # Test data query = "What is the capital of France?" document = "Paris is the capital of France." sentence_ranking_style_inputs = [[query, document]] text_classification_style_inputs = [{"text": query, "text_pair": document}] # 1. Using post method response_bytes = client.post(json={"inputs": sentence_ranking_style_inputs}) print(json.loads(response_bytes)) # Problem: post method has deprecation warning # 2. Using text_classification task try: result = client.text_classification(text_classification_style_inputs) # There's no way to inject the inputs format that would have worked on this task for reranking print(result) except Exception as e: print(f"text_classification error: {e}") # Problem: text_classification doesn't properly support text pairs format needed for reranking/cross-encoding # 3. Using sentence_similarity task try: result = client.sentence_similarity(sentence_ranking_style_inputs) # There's no direct way to inject the inputs format that would have worked on this task for reranking print(result) except Exception as e: print(f"sentence_similarity error: {e}") # Problem: No direct support for sentence ranking despite endpoint supporting this task ``` Ideally, the sentence_ranking task is supported. ### Logs ```shell ``` ### System info ```shell - huggingface_hub version: 0.30.2 - Platform: macOS-15.4-arm64-arm-64bit - Python version: 3.12.10 - Running in iPython ?: No - Running in notebook ?: No - Running in Google Colab ?: No - Running in Google Colab Enterprise ?: No - Token path ?: redacted - Has saved token ?: False - Configured git credential helpers: redacted - FastAI: N/A - Tensorflow: N/A - Torch: 2.7.0 - Jinja2: 3.1.6 - Graphviz: N/A - keras: N/A - Pydot: N/A - Pillow: 11.2.1 - hf_transfer: N/A - gradio: N/A - tensorboard: N/A - numpy: 1.26.4 - pydantic: 2.11.4 - aiohttp: 3.11.18 - hf_xet: N/A - ENDPOINT: https://huggingface.co - HF_HUB_CACHE: redacted - HF_ASSETS_CACHE: redacted - HF_TOKEN_PATH: redacted - HF_STORED_TOKENS_PATH: redacted - HF_HUB_OFFLINE: False - HF_HUB_DISABLE_TELEMETRY: False - HF_HUB_DISABLE_PROGRESS_BARS: None - HF_HUB_DISABLE_SYMLINKS_WARNING: False - HF_HUB_DISABLE_EXPERIMENTAL_WARNING: False - HF_HUB_DISABLE_IMPLICIT_TOKEN: False - HF_HUB_ENABLE_HF_TRANSFER: False - HF_HUB_ETAG_TIMEOUT: 10 - HF_HUB_DOWNLOAD_TIMEOUT: 10 ```

Solution for SentenceTransformers:

omsite45 · May 25, 2025, 8:07am

ANY SOLUTION GUYS ??

KINDLY PLEASE PROVIDE THE SOLUTION

John6666 · May 25, 2025, 10:44am

Hmm… For example, for langchain: I am getting this error on langchain

tempdeltavalue · May 26, 2025, 8:59pm

same

John6666 · May 27, 2025, 12:05am

Hmm… It seems that this cannot be resolved with a user patch…
I think you need to raise an issue to resolve this.

Topic		Replies	Views
Feature extraction using Inference API error Beginners	3	1679	December 15, 2024
https://api-inference.huggingface.co/models/sentence-transformers/paraphrase-MiniLM-L6-v2 Beginners	7	208	May 8, 2025
I'm having an error message working with my User access tokens Inference Endpoints on the Hub	17	12167	April 4, 2025
Inference API - ERROR \| 'str object' has no attribute 'role' Beginners	0	320	April 11, 2024
Model does not exist, inference API don't work 🤗Transformers	5	272	March 13, 2025

GETTING ERROR >> AttributeError: 'InferenceClient' object has no attribute 'post'

Related topics