I think you didn’t use any prompt. I am sure you know about prompt. So you should use system prompt and assist prompt and so on. And your model doesn’t work well in real world situations. So I recommend you use llama-instruct model. This model retrained on the real world problems especially, chatbot, summarization. And it also work well on various types of prompt.
1 Like