I want to use meta-llama/Llama-2-70b-chat-hf in my notebook, but I am running into some problems. I am using Transformers version 4.30.2. Code: import torch from transformers import AutoModelForCausalLM, AutoTokenizer if __name__ == "__main__": tokenizer = AutoTokenizer.from_pretrained("meta…

LLama 70B not working

aljaz-potocnik August 8, 2023, 1:04pm 2

Actually upgrading to transformers 4.31 solved the problem.

Topic		Replies	Views
Could not load model meta-llama/Llama-2-7b-chat-hf with any of the following classes 🤗Transformers	22	49461	December 19, 2024
Simple use of Transformers breaks Beginners	1	1374	June 2, 2023
LLama 3.1 torch.compile & static cache 🤗Transformers	2	284	December 9, 2024
Prompt printing gibberish Beginners	1	680	September 15, 2023
Llama model outputs strange words Beginners	0	124	December 1, 2024