Max length transformers problem

eyaHarbaoui March 4, 2023, 10:25pm 1

Max length transformers problem what techniques to use to fit transformers with more than 512 tokens

Topic		Replies	Views
Importance of padding for tokens and same size inputs for transformers 🤗Transformers	1	414	October 22, 2021
Data sampler based on number of tokens 🤗Transformers	0	620	February 4, 2022
Out of Memory on very small custom transformer Models	7	1823	October 12, 2020
Why do Pipelines allow more than 512 tokens? Beginners	1	484	April 4, 2023
Appropriate tokenizer for particular dataset? 🤗Transformers	0	211	September 18, 2022