Hi, I am getting different sequence for microsoft/Phi-3-mini-4k-instruct when i set return_dict_in_generate=True in model.generate? Example output: [ {'role': '…

Difference in return sequence for Phi3 model

exploiter345 June 10, 2024, 1:36am 10

Confirming that following change fixes the issue. The key change is adding eos_token_id

1 Like