Ai Agents course error in running the Smolagent example

Course
1

Hello, following unit 1, in the AI agent course, running the given application built in smolagent below. The question is time in EST now?

Any ideas? what am I missing here.

Final answer:
Error in generating final LLM output:
422 Client Error: Unprocessable Entity for url: https://api-inference.huggingface.co/models/Qwen/Qwen2.5-Coder-32B-Instruct/v1/chat/completions (Request ID: Zji2Dy1jhRHQ_jjXJLqQx)

Input validation error: inputs tokens + max_new_tokens must be <= 32768. Given: 89942 inputs tokens and 2096 max_new_tokens
Make sure ‘text-generation’ task is supported by the model.

1 Like
2

Input validation error: inputs tokens + max_new_tokens must be <= 32768. Given: 89942 inputs tokens and 2096 max_new_tokens

The error message says that the input tokens are too large and exceed 32768 (-2096), so it can’t be processed, but if this is the result of following the course, then it’s a bug in the course in a broad sense…
If possible, why not try changing the model?
Or raising issue?

3

I am having issues while running the agents using HfApiModel(). Following is the syntax and the error:
from smolagents import CodeAgent, DuckDuckGoSearchTool, HfApiModel

Initialize the search tool

search_tool = DuckDuckGoSearchTool()

Initialize the model

model = HfApiModel(hf_model)

agent = CodeAgent(
model = model,
tools=[search_tool]
)

Example usage

response = agent.run(
“Search for luxury superhero-themed party ideas, including decorations, entertainment, and catering.”
)
print(response)

Error in generating model output:
402 Client Error: Payment Required for url:
https://router.huggingface.co/hf-inference/models/Qwen/QwQ-32B/v1/chat/completions (Request ID:
Root=1-67eb90ed-4dceeaaf55ae88031ef4b296;dc2390e1-cf09-4f27-b530-c55bff8d2db7)

You have exceeded your monthly included credits for Inference Providers. Subscribe to PRO to get 20x more monthly
included credits.

I know that it is asking for upgrading HF subscription, but is there any way I can use it for free? I am a beginner at HF

1 Like
4

That’s just a simple case of exceeding the usage limit, so it’s a bit difficult, but I think you could get around it by using a local model or using another company’s API.

5

The only way I got around this was upgrading my HF account. I know that’s not the ideal solution, and not something that should be the easiest path forward, but I guess you can downgrade your account after the course is completed.

1 Like