Blank Responses

[Rivers-Kosmos]

I am having problems especially with

TheBloke_Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GGML

I have some good conversations and then the responses disappear and a blank response occurs. I have looked through many of these forums and can’t find anything where something similar is occurring.

It doesn’t seem to matter what my tokens amount is nor the pre-set I choose that this will happen. I have also played around with GPU offloading but my PC isn’t running hard and wasn’t running hard when this occurs mostly. Possibly a few times but in this instance, my fans were running at normal speed with the pic.

Anyone have any suggestions to try?

Thanks,

[Bjornedt]

Hi!

What does your prompt look like? It’s possible that you are sending some tokens that lead to this behavior for example a \n at the end.

If you are using a stop token try to remove it and see what happens.

Another thing to check is if maybe you are filtering the response in your production app.

Hope that helps.