Im looking for a model that accepts input like 50k characters and a prompt answering a question based on that text. Ive tried "valhalla/longformer-base-4096-finetuned-squadv1 but it doesnt work well. Is there anything like that?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
My input sentence is very long(more than 512). What should I do when I want to fintune model about classify?Thanks | 3 | 1116 | September 3, 2021 | |
Is the way to input large size of text (over 512 words) exist? | 0 | 946 | October 27, 2021 | |
Long Context Instruct LLM Recommendations | 1 | 557 | December 20, 2023 | |
Fine tuning Sequence | 0 | 215 | August 27, 2021 | |
Https://huggingface.co/allenai/longformer-large-4096-finetuned-triviaqa | 0 | 1141 | March 28, 2022 |