Error loading tokenizer: data did not match any variant of untagged enum ModelWrapper at line 1251003 column 3

John6666 · October 10, 2024, 7:42am

I heard that updating the library may fix the problem.

[FIXED] Exception: data did not match any variant of untagged enum ModelWrapper at line 1251003 column 3

opened 08:06PM - 25 Sep 24 UTC

fixed - pending confirmation URGENT BUG

I get this error: ``` Traceback (most recent call last): File "/home/deni…s/Documents/ai/unsloth/llama3-chat-template.py", line 20, in <module> model, tokenizer = FastLanguageModel.from_pretrained( File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/unsloth/models/loader.py", line 323, in from_pretrained model, tokenizer = dispatch_model.from_pretrained( File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/unsloth/models/llama.py", line 1610, in from_pretrained tokenizer = load_correct_tokenizer( File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/unsloth/tokenizer_utils.py", line 538, in load_correct_tokenizer tokenizer = _load_correct_tokenizer( File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/unsloth/tokenizer_utils.py", line 496, in _load_correct_tokenizer fast_tokenizer = AutoTokenizer.from_pretrained( File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 897, in from_pretrained return tokenizer_class.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs) File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2271, in from_pretrained return cls._from_pretrained( File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2505, in _from_pretrained tokenizer = cls(*init_inputs, **init_kwargs) File "/home/denis/miniconda3/envs/pytorch/lib/python3.10/site-packages/transformers/tokenization_utils_fast.py", line 115, in __init__ fast_tokenizer = TokenizerFast.from_file(fast_tokenizer_file) Exception: data did not match any variant of untagged enum ModelWrapper at line 1251003 column 3 ``` It works with `nsloth/Llama-3.2-1B-Instruct-bnb-4bit`

Topic		Replies	Views
Deployment issue on Sagemaker Amazon SageMaker	16	3339	October 4, 2023
Error loading finetuned llama2 model while running inference Amazon SageMaker	27	4816	September 20, 2023
ValueError: Could not load model /opt/ml/model with any of the following classes: (<class 'transformers.models.auto.modeling_auto.AutoModelForCausalLM'>, <class 'transformers.models.llama.modeling_llama.LlamaForCausalLM'>) Amazon SageMaker	0	395	March 13, 2024
How are the inputs tokenized when model deployment? Amazon SageMaker	13	4282	September 3, 2021
Inference failed for FLAN-UL2(20B) on SageMaker Amazon SageMaker	6	2170	April 4, 2023

Error loading tokenizer: data did not match any variant of untagged enum ModelWrapper at line 1251003 column 3

Related topics