I know I can intercept the first 512 lengths.But I don’t want to do this. This task can understand the classification of texts. AutoModelForSequenceClassification can be directly used for classification, but the question is whether the input can be some 512 length sentences, and use pooler layer t…

My input sentence is very long(more than 512). What should I do when I want to fintune model about classify?Thanks

ccfeidao September 3, 2021, 4:49am 4

I want to user BigBird to try my task, but have a new problem, I am very Confusion.

Topic		Replies	Views
Token Classification Models on (Very) Long Text Models	8	10807	March 9, 2023
Token classification on long sentences 🤗Transformers	0	824	February 2, 2022
Sentiment analysis for long text - canonical solution Beginners	1	2363	April 22, 2023
How do I search for sentence transformer models by context window/token length/word piece count? 🤗Hub	0	602	March 27, 2024
Model for Long Text Classification Beginners	0	342	February 20, 2024