Input validation error: inputs tokens + max_new_tokens must be <= 32768. Given: 89942 inputs tokens and 2096 max_new_tokens
Make sure ‘text-generation’ task is supported by the model.
Input validation error: inputs tokens + max_new_tokens must be <= 32768. Given: 89942 inputs tokens and 2096 max_new_tokens
The error message says that the input tokens are too large and exceed 32768 (-2096), so it can’t be processed, but if this is the result of following the course, then it’s a bug in the course in a broad sense…
If possible, why not try changing the model?
Or raising issue?
I am having issues while running the agents using HfApiModel(). Following is the syntax and the error:
from smolagents import CodeAgent, DuckDuckGoSearchTool, HfApiModel
Initialize the search tool
search_tool = DuckDuckGoSearchTool()
Initialize the model
model = HfApiModel(hf_model)
agent = CodeAgent(
model = model,
tools=[search_tool]
)
Example usage
response = agent.run(
“Search for luxury superhero-themed party ideas, including decorations, entertainment, and catering.”
)
print(response)
That’s just a simple case of exceeding the usage limit, so it’s a bit difficult, but I think you could get around it by using a local model or using another company’s API.
The only way I got around this was upgrading my HF account. I know that’s not the ideal solution, and not something that should be the easiest path forward, but I guess you can downgrade your account after the course is completed.
Yes, most of the errors disappeared once I upgraded my account. Looks like a capacity issue ( Token counts aren’t being properly returned from the model API).
Although, I did make some changes to the Gradio_UI.py file to resolve some Type issues - similar to the below