Hi, I’d like to use the model namespace-Pt/activation-beacon-llama2-7b-chat. It’s a model with a 400k context window, which is what I want. But when I try to launch a dedicated Inference Endpoints, when I use it, it says {‘error’: 'Input validation error: inputs tokens + max_new_tokens must be <= …

Problem for large context window (400k)

Rayisy May 2, 2024, 11:38am 2

I need help!!!

Topic		Replies	Views
Trying to setup Long-Context LLM endpoint Beginners	2	241	August 17, 2024
How to increase max_new_tokens beyond 1200 in code llama Models	2	812	September 25, 2024
Llama 2 deployed with different content lengths? Inference Endpoints on the Hub	1	651	August 31, 2023
Code Llama Instruct 34B accepts only 4096 tokens on PRO Site Feedback	0	614	January 11, 2024
Number of tokens (2331) exceeded maximum context length (512) error.Even when model supports 8k Context length 🤗Transformers	8	15441	October 6, 2024