Here is my code snippet: llm = HuggingFaceEndpoint(
repo_id=“Qwen/Qwen2.5-14B-Instruct-1M”,
task=“text-generation”,
max_new_tokens=20,
do_sample=False,
repetition_penalty=1.03,
temperature=0.00
)
chat = ChatHuggingFace(llm=llm, verbose=True)
1 Like