Shortformer: Better Language Modeling using Shorter Inputs

FL33TW00D December 31, 2020, 10:02am 1

Interesting paper focusing on shorter context windows and improving training speed!

2 Likes

Topic		Replies	Views
TinyReformer/TinyLongformer details Models	3	346	November 6, 2020
Community content of the week (01/13/2022) Community Calls	0	1622	January 13, 2022
Looking for a IPA2vec model Models	0	171	May 18, 2023
Community content of the week (01/20/2022) Community Calls	0	1766	January 20, 2022
Community content of the week (12/23/2021) Community Calls	1	1845	December 28, 2021