Error loading tokenizer: data did not match any variant of untagged enum ModelWrapper at line 1251003 column 3

John6666 · October 10, 2024, 7:42am

I heard that updating the library may fix the problem.

[FIXED] Exception: data did not match any variant of untagged enum ModelWrapper at line 1251003 column 3

opened 08:06PM - 25 Sep 24 UTC

fixed - pending confirmation URGENT BUG

I get this error: ``` Traceback (most recent call last): File "/home/deni…s/Documents/ai/unsloth/llama3-chat-template.py", line 20, in <module> model, tokenizer = FastLanguageModel.from_pretrained( File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/unsloth/models/loader.py", line 323, in from_pretrained model, tokenizer = dispatch_model.from_pretrained( File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/unsloth/models/llama.py", line 1610, in from_pretrained tokenizer = load_correct_tokenizer( File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/unsloth/tokenizer_utils.py", line 538, in load_correct_tokenizer tokenizer = _load_correct_tokenizer( File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/unsloth/tokenizer_utils.py", line 496, in _load_correct_tokenizer fast_tokenizer = AutoTokenizer.from_pretrained( File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 897, in from_pretrained return tokenizer_class.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs) File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2271, in from_pretrained return cls._from_pretrained( File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2505, in _from_pretrained tokenizer = cls(*init_inputs, **init_kwargs) File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/transformers/tokenization_utils_fast.py", line 115, in __init__ fast_tokenizer = TokenizerFast.from_file(fast_tokenizer_file) Exception: data did not match any variant of untagged enum ModelWrapper at line 1251003 column 3 ``` It works with `nsloth/Llama-3.2-1B-Instruct-bnb-4bit`

Topic		Replies	Views
Issue in deploying quantized meta-llama/Llama-3.1-8B-Instruct in aws sagemaker Intermediate	0	52	October 10, 2024
Errors running Inference Endpoint with quantized model Inference Endpoints on the Hub	2	777	September 14, 2023
Getting an error when deploying llama2 7B on custom dataset using sagemaker inference endpoint Beginners	0	171	March 18, 2024
ValueError: Could not load model /opt/ml/model with any of the following classes: (<class 'transformers.models.auto.modeling_auto.AutoModelForCausalLM'>, <class 'transformers.models.llama.modeling_llama.LlamaForCausalLM'>) Amazon SageMaker	0	375	March 13, 2024
Error loading Llama model Beginners	5	1482	March 9, 2024

Error loading tokenizer: data did not match any variant of untagged enum ModelWrapper at line 1251003 column 3

Related topics