Hi, I am trying to load tokenizer for llama2 using AutoTokenizer but I am facing this issue “”“OSError: Can’t load tokenizer for ‘meta-llama/Llama-2-7b-hf’. If you were trying to load it from ‘ Models - Hugging Face ’, make sure you don’t have a local directory with the same name. Otherwise, make su…

Cannot load tokenizer for llama2

shinieaggarwal September 7, 2024, 7:17pm 6

hi, what did you put in the variable model_id?? i am trying it on colab and facing this same issue

Topic		Replies	Views
Unable to load tokenizer 🤗Transformers	3	67	February 14, 2025
I was using huugginfface meta-llama/Llama-2-7b-chat-hf and im facing an error 🤗Tokenizers	2	2567	October 8, 2023
AutoTokenizer is very slow when loading llama tokenizer 🤗Tokenizers	2	1845	October 31, 2023
Using Token to Access Llama2 Beginners	3	14758	February 21, 2024
OSError: Can't load tokenizer for 'meta-llama/CodeLlama-7b-hf' Beginners	1	245	December 25, 2024