Data did not match any variant of untagged enum PyPreTokenizerTypeWrapper at line 6952 column 3

Models
1

I am trying to use Mistral 7B model v0.3 it is showing this error for the code
from huggingface_hub import login
login(token=“my token removed for security reason”)
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = “mistralai/Mistral-7B-v0.3”
tokenizer = AutoTokenizer.from_pretrained(model_id)

model = AutoModelForCausalLM.from_pretrained(model_id)
inputs = tokenizer(“Hello my name is”, return_tensors=“pt”)

outputs = model.generate(**inputs, max_new_tokens=20)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

4 Likes
2

you could use an older version of the model files