Dears,
It is the second day now i am trying various models on HF though getting error.
mainly Request failed: 429 {“error”:“Model is overloaded”,“error_type”:“overloaded”}
HF_API_URL = “https://api-inference.huggingface.co/models/Qwen/Qwen2.5-72B-Instruct”
#HF_API_URL = “https://api-inference.huggingface.co/models/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B”
#HF_API_URL = “https://api-inference.huggingface.co/models/meta-llama/Llama-3.3-70B-Instruct”
#HF_API_URL = “https://api-inference.huggingface.co/models/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF”
From the above only the R1 works some won’t even respond. I am a nub but would appreciate if someone can tell me what’s the point of having a pro account and still not having access to these?
thanks,
ed