The error “Max_new_tokens” typically occurs when you attempt to generate text using a model like Meta-Llama-3-8B-Instruct and set a value for max_new_tokens that is either too high or incompatible with the model’s configuration. Here’s how to troubleshoot and resolve this issue: Check Max Tokens S…

Validation Error: Meta-Llama-3-8B-Instruct

encryptman November 19, 2024, 9:29am 2

Just for confirmation, do you still need any help?

Topic		Replies	Views
Meta-Llama-3-8B-Instruct: Validation Error "Max_new_tokens" Models	6	663	October 2, 2024
Meta-Llama-3-8B-Instruct: "max_new_tokens" is not working for /v1/chat/completions Intermediate	1	845	July 2, 2024
Max_new_token issue when send query Beginners	0	162	March 28, 2024
Chat Usage Error - "Input validation error" Models	0	639	May 2, 2024
HfHubHTTPError: 500 Server Error:Meta-Llama-3-8B-Instruct Models	0	32	August 29, 2024