How to resolve the hugging face error ImportError: cannot import name 'is_tokenizers_available' from 'transformers.utils'?

Have you tried running the code without Eclipse/Pycharm ? It seems pydev uses some kind of magic in between transformers calls. Have you also tried uninstalling (making sure the version was uninstalled) and then reinstalling transformers ?

Nb: This is probably not linked to CentOS or any of the related issues. Also please try not to spam everywhere at once with your questions, you are not maximizing your chances of getting a good answer.

1 Like