Whenever I try and set the model with model = MixtralForCausalLM.from_pretrained(model_path, local_files_only=True)
, the Script simply stops. Nothing after that line of code runs. The path leads to the cache with the files, which works when I run tokenizer = AutoTokenizer.from_pretrained(tokenizer_path, local_files_only=True)
. They have the same path, just different variables. What could I do to try and fix it?