I can get HuggingFaceInferenceAPI to work by adding the provider as below.
llm = HuggingFaceInferenceAPI(
model_name=“Qwen/Qwen2.5-Coder-32B-Instruct”,
temperature=0.7,
max_tokens=100,
token=hf_token,
provider=“together”,
)
I can get HuggingFaceInferenceAPI to work by adding the provider as below.
llm = HuggingFaceInferenceAPI(
model_name=“Qwen/Qwen2.5-Coder-32B-Instruct”,
temperature=0.7,
max_tokens=100,
token=hf_token,
provider=“together”,
)