Longformer(LED) map out Global Tokens

anwarika April 18, 2022, 6:36pm 1

Is there a way to see what the model is using for global tokens in summarization?

Topic		Replies	Views
Summarization pipeline on long text Beginners	6	4510	December 14, 2022
Longformer for text summarization Beginners	10	5256	August 6, 2022
Is summary of 1024 tokens not useless? 🤗Transformers	1	665	July 1, 2022
"Initializing global attention on CLS token" on Longformer Training Beginners	1	1131	October 7, 2021
How to forward pass? Beginners	0	514	November 10, 2023