Hello!
I’m trying to make a simple ‘choose your own path’ fantasy interactive text game using Mistral-7b-Instruct and python.
I have a rough setup that lets me bounce back and forth between player and ‘engine’.
But I’m constantly seeing the same responses from the model. Its an opening in the forest with a Elf with long hair, or its a bunch of goblins hoping around a fire. Etc. The same ones keep coming back even if I change the initiating text prompt. I get variations now and then sure but on the whole too repetitive and similar.
Is there a ‘seed’ or something I can add to push it around into new spaces?
I want the model to come up with new scenarios and not me having to hand-hold it with explicit prompt text.
EDIT: I currently have temperature=0.9 and tried top_p=0.5->0.95
do_sample=True
Any ideas how this can be achieved?
Cheers!