Why does the falcon QLoRA tutorial code use eos_token as pad_token?

Models
7

**tldr; what I really want to know is what is the official way to set pad token for fine tuning it wasn’t set during original training, so that it doesn’t not learn to predict EOS. **

1 Like