What are the best inference hyperparameters of Qwen 2.5 coder 7b? I tried only do_sample=True and do_sample=False and I can’t understand why but model with do_sample=True has better quality than with do_sample=False. Maybe it’s because I didn’t pass good enough temperature, top_p, top_k parameters with do_sample=False. Can somebody who used this model tell me about it?
1 Like