Model for big context window

Im looking for a model that accepts input like 50k characters and a prompt answering a question based on that text. Ive tried "valhalla/longformer-base-4096-finetuned-squadv1 but it doesnt work well. Is there anything like that?