import torch from transformers import GPT2Tokenizer, GPT2LMHeadModel model_name = "gpt2" #output_dir # tokenizer = GPT2Tokenizer.from_pretrained(model_name, padding_side='left', add_eos_token=True) #gpt2 llm_model = GPT2LMHeadModel.from_pretrained(model_name) # gpt2 device = torch.device('cuda') l…

Repetitive words in model output

tempdeltavalue December 18, 2024, 1:02pm 2

1 Like

Topic		Replies	Views
Need help with gpt2 model Beginners	0	575	July 9, 2023
Infinity output from gpt2 model? Beginners	2	140	June 22, 2024
Prevent repeat tokens in GPT2LMHeadModel text generation with max_new_tokens=1 Beginners	0	1099	November 19, 2021
Llama model outputs strange words Beginners	0	96	December 1, 2024
I have problem with teaching GPT-2 large model (774m) with transformers Models	2	797	March 1, 2023