Blank Responses

I am having problems especially with


I have some good conversations and then the responses disappear and a blank response occurs. I have looked through many of these forums and can’t find anything where something similar is occurring.

It doesn’t seem to matter what my tokens amount is nor the pre-set I choose that this will happen. I have also played around with GPU offloading but my PC isn’t running hard and wasn’t running hard when this occurs mostly. Possibly a few times but in this instance, my fans were running at normal speed with the pic.

Anyone have any suggestions to try?



What does your prompt look like? It’s possible that you are sending some tokens that lead to this behavior for example a \n at the end.

If you are using a stop token try to remove it and see what happens.

Another thing to check is if maybe you are filtering the response in your production app.

Hope that helps.