Thanks @meganariley for these clarifications!
Could there be a case where using an inference endpoint locally w/in a PRO account and available credits via: api-inference.huggingface.co
while running the same request via Colab - which I think goes to: router.huggingface.co/hyperbolic
would result in the following error? This is specific to meta-llama/Llama-3.1-8B-Instruct
.
Model meta-llama/Llama-3.1-8B-Instruct is in staging mode for provider hyperbolic. Meant for test purposes only.
WARNING:huggingface_hub.inference._providers._common:Model meta-llama/Llama-3.1-8B-Instruct is in staging mode for provider hyperbolic. Meant for test purposes only.
---------------------------------------------------------------------------
HTTPError Traceback (most recent call last)
/usr/local/lib/python3.11/dist-packages/huggingface_hub/utils/_http.py in hf_raise_for_status(response, endpoint_name)
408 try:
--> 409 response.raise_for_status()
410 except HTTPError as e:
HTTPError: 402 Client Error: Payment Required for url: https://router.huggingface.co/hyperbolic/v1/chat/completions
The above exception was the direct cause of the following exception:
HfHubHTTPError Traceback (most recent call last)
/usr/local/lib/python3.11/dist-packages/huggingface_hub/utils/_http.py in hf_raise_for_status(response, endpoint_name)
480 # Convert `HTTPError` into a `HfHubHTTPError` to display request information
481 # as well (request id and/or server error message)
--> 482 raise _format(HfHubHTTPError, str(e), response) from e
HfHubHTTPError: 402 Client Error: Payment Required for url: https://router.huggingface.co/hyperbolic/v1/chat/completions (Request ID: Root=1-683b8f1e-40ffd8d13bc382863e9fdd53;d8fc62ff-f3bb-4ee6-9164-5391ea6b02e1)
I’m curious if I’m running into some sort of additional gating or permission issue, or if I reached some limit w/in Hyperbolic via HF that is requiring additional payment?
Thanks!
Hello @meganariley
I am facing 402 error eventhough I have upgraded to Pro. I am currently pursuing the Agent course and the tokens are set with write permission. I am to run the model. Can you please let me know if there is any solution for the issue.