This fix by @sgugger in a recent commit resolved the issue for me. The fix is not in the official release yet, but you can install the bleeding edge version of the Transformers library from source using pip install git+https://github.com/huggingface/transformers which pulls it from GitHub.
1 Like