Proper settings for a support chatbot?

Beginners
1

Hey everyone! I’m Jay, new to Huggingface, and I have a few questions.

Context:
I’m setting up a RAG chatbot in an embedded iframe window. The bot should be friendly, professional, and concise. It will provide user support and keep users informed about our activities.

My main question is about the best settings for the chatbot. I’m currently using the default model “HuggingFaceH4/zephyr-7b-beta” but I’m looking for a 7b parameter model that is highly safe and suitable for a business environment. Any recommendations?

Here’s a snippet of my code:

demo = gr.ChatInterface(
    respond,
    additional_inputs=[
        gr.Textbox(value="You are a friendly Chatbot.", label="System message"),
        gr.Slider(minimum=1, maximum=2048, value=512, step=1, label="Max new tokens"),
        gr.Slider(minimum=0.1, maximum 4.0, value=0.7, step=0.1, label="Temperature"),
        gr.Slider(
            minimum=0.1,
            maximum=1.0,
            value=0.95,
            step=0.05,
            label="Top-p (nucleus sampling)",
        ),
    ],

Thanks for your help!