Hugging Face Forums
Shortformer: Better Language Modeling using Shorter Inputs
Research
FL33TW00D
December 31, 2020, 10:02am
1
Interesting paper focusing on shorter context windows and improving training speed!
2 Likes
Related topics
Topic
Replies
Views
Activity
TinyReformer/TinyLongformer details
Models
3
431
November 6, 2020
Context is all you need. Shifting focus for language modeling
Research
0
46
April 1, 2025
Community content of the week (01/13/2022)
Community Calls
0
1736
January 13, 2022
Looking for a IPA2vec model
Models
1
238
February 18, 2025
Community content of the week (01/20/2022)
Community Calls
0
1847
January 20, 2022