Ah. I tried to be returned only the added text, but it’s returning only the questions in reverse.
Also, maybe it’s too strict and the LLM is having trouble answering.
How about a simple one? It means maybe temperature=0.7 and do_sample=True.
response = generator(
question,
)