Hello,
Using the following code to load Mistral Nemo 12B from a cached drive -
from transformers import AutoModel, AutoTokenizer
from transformers import pipeline
messages = [
{“role”: “system”, “content”: “You are a pirate chatbot who always responds in pirate speak!”},
{“role”: “user”, “content”: “Who are you?”},
]
tokenizer = AutoTokenizer.from_pretrained(“/Users/e164328/.cache/huggingface/hub/models–mistralai–Mistral-Nemo-Instruct-2407/snapshots/05b1e4f3e189ec1b5189fb3c973d4cf3369c27af”)
model = AutoModel.from_pretrained(“/Users/e164328/.cache/huggingface/hub/models–mistralai–Mistral-Nemo-Instruct-2407/snapshots/05b1e4f3e189ec1b5189fb3c973d4cf3369c27af”)
chatbot = pipeline(task=“text-generation”,model = model,tokenizer=tokenizer)
chatbot(messages)
Getting RuntimeError: Failed to import transformers.pipelines because of the following error (look up to see its traceback):
maximum recursion depth exceeded while calling a Python object