Setting `pad_token_id` to `eos_token_id`:128001 for open-end generation

Models
2

I’m not familiar with it either, but I’ve heard that that setting and Llama3 being weird are two separate issues. The first link explains the settings, the second link explains what’s wrong with Llama3. You can find more if you do a search.