I am using the Longformer for sequence classification task (taking example code from here), the model is running somehow on a small batch, the issue is with the wrong predictions, is there any example of the Longformer sequence classification for GLUE tasks. thanks

Longformer for sequenceclassification

valhalla October 13, 2020, 7:20am 2

try the example script here

1 Like

Topic		Replies	Views
Longformer for sequence classification throwing error regarding data format and shape 🤗Transformers	2	224	June 11, 2024
Huggingface classification struggling with prediction 🤗Transformers	0	835	April 5, 2022
Fine-tuned longformer classifies all test samples as False Beginners	0	351	May 19, 2022
What happened when Longformer is trained on dataset longer than 4096? 🤗Transformers	0	296	June 29, 2021
Reproducibility of LongFormer Model 🤗Transformers	0	15	August 30, 2024