JSON Schema Response Format NOT Working: invalid_request_error

[John6666]

The Function Calling in TGI or Transformers has been buggy for a while now. If it hasn’t been fixed yet, it might be because of this…

Tool calling gets stuck in an infinite loop

I’m having problems using tool calling with the inference endpoint. I’m following the documentation (such as it is), and the examples in Tool Use, Unified. But the API doesn’t seem to recognise that I’ve returned a result, and just returns another tool call request: { "messages": [ { "role": "system", "content": "Be very terse, not even punctuation." }, { "role": "user", "content": [ { "type": "text", "text": "What's the current …