I’m using GPT-J (EleutherAI/gpt-j-6B) as a chatbot. As a prompt, I provide a sample conversation as shown below. When now a new conversation starts, I append the input of the user to this sample conversation (“Hello, how are you doing?” in the example below).
Now, the problem is that the conversation is sometimes inconsistent because GPT-J might want to continue the sample conversation but the new user input could break that.
How can this be solved?
This is a discussion between a Human and a Chatbot.
Can you do push-ups?
Of course I can. It’s a piece of cake! Believe it or not, I can do 30 push-ups a minute.
Really? I think that’s impossible!
You mean 30 push-ups?
It’s easy. If you do exercise everyday, you can make it, too.
Hello, how are you doing?