I am at a bit of a loss right now:
No matter how I try to use any model from huggingface, the process won’t terminate. I have tried using the pipeline, I have tried retrieving models via the
from_pretrained(...) method, I let the process run for a while, but nothing changed after twenty minutes. I really don’t know where the problem is, especially because there aren’t any console logs that might have helpful information and because I am not even using the model for anything (afaic).
The only thing I have is the console log when I interrupt the process manually:
KeyboardInterrupt Traceback (most recent call last) Cell In, line 2 1 from transformers import AutoTokenizer ----> 2 tokenizer = AutoTokenizer.from_pretrained("dbmdz/german-gpt2") File c:\Users\User\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\models\auto\tokenization_auto.py:697, in AutoTokenizer.from_pretrained(cls, pretrained_model_name_or_path, *inputs, **kwargs) 695 tokenizer_class_py, tokenizer_class_fast = TOKENIZER_MAPPING[type(config)] 696 if tokenizer_class_fast and (use_fast or tokenizer_class_py is None): --> 697 return tokenizer_class_fast.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs) 698 else: 699 if tokenizer_class_py is not None: File c:\Users\User\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\tokenization_utils_base.py:1763, in PreTrainedTokenizerBase.from_pretrained(cls, pretrained_model_name_or_path, *init_inputs, **kwargs) 1761 resolved_vocab_files[file_id] = download_url(file_path, proxies=proxies) 1762 else: -> 1763 resolved_vocab_files[file_id] = cached_file( 1764 pretrained_model_name_or_path, 1765 file_path, 1766 cache_dir=cache_dir, 1767 force_download=force_download, 1768 proxies=proxies, 1769 resume_download=resume_download, 1770 local_files_only=local_files_only, 1771 use_auth_token=use_auth_token, ... --> 187 time.sleep(poll_interval) 188 except BaseException: # Something did go wrong, so decrement the counter. 189 with self._thread_lock: KeyboardInterrupt:
I found out that the last line of code come from the Python filelock package, maybe this will help determining where the source of the problem is. Thanks in advance!