Tokenizer deprecating in ORPO

In a local environment, this change alone would be a workaround, but it would be best to wait until it is fixed for the latest version.

pip uninstall transformers
pip install transformers==4.45.2
3 Likes