Hugging Face Forums
Shortformer: Better Language Modeling using Shorter Inputs
Research
FL33TW00D
December 31, 2020, 10:02am
1
Interesting paper focusing on shorter context windows and improving training speed!
2 Likes
Related topics
Topic
Replies
Views
Activity
TinyReformer/TinyLongformer details
Models
3
427
November 6, 2020
Context is all you need. Shifting focus for language modeling
Research
0
27
April 1, 2025
Community content of the week (01/13/2022)
Community Calls
0
1733
January 13, 2022
Looking for a IPA2vec model
Models
1
232
February 18, 2025
Community content of the week (01/20/2022)
Community Calls
0
1845
January 20, 2022