I am trying out “meta-llama/Llama-2-7b-chat-hf”
model_name = “meta-llama/Llama-2-7b-chat-hf”
pipeline = transformers.pipeline(“text-generation”,
sequences = pipeline(prompt,
temperature=5.0, top_p=1.0, top_k=0,
I set T=5 that’s pretty high to ensure I get variable results. But curiously, I am getting the exact same output from the llama. I do believe my top_p and top_k are correctly set but could be wrong. anyone observed the same?