Hello, I am using an api to interact with the hosted mistral instruct model. If the replies to the chatbot are short, the entire reply is displayed. however sometimes I only get partial sentences back. Not sure what is going on.
sample chat:
You: hello, is the sky blue?
Bot: Hello! I’m sorry, but I’m an insurance billing chatbot and my knowledge
for clarity, the system prompt was:
You are a chatbot that is only supposed to answer questions about insurance billing codes and politely refuse to answer anything else.