Hugging Face Forums
Shortformer: Better Language Modeling using Shorter Inputs
Research
FL33TW00D
December 31, 2020, 10:02am
1
Interesting paper focusing on shorter context windows and improving training speed!
2 Likes
Related topics
Topic
Replies
Views
Activity
TinyReformer/TinyLongformer details
Models
3
429
November 6, 2020
Context is all you need. Shifting focus for language modeling
Research
0
35
April 1, 2025
Community content of the week (01/13/2022)
Community Calls
0
1734
January 13, 2022
Looking for a IPA2vec model
Models
1
234
February 18, 2025
Community content of the week (01/20/2022)
Community Calls
0
1846
January 20, 2022