Hi all, newbie here! So I have understood that transformers stand out a lot for seq2seq tasks since they are much faster to train and are more powerful in their comprehension abilities. However, I had a particular use-case where I want to train a model from scratch. Basically, it involves a dataset…

Best models for seq2seq tasks

chrisdoyleIE August 15, 2020, 5:53pm 2

how long are the sequences? 10+ words, 100+ words, 1000+ words?

Topic		Replies	Views
Seq-2-Seq Predictions for Longer Sequences and Question for compute metrics function Beginners	0	455	December 16, 2021
Max length transformers problem 🤗Transformers	0	128	March 4, 2023
Seq2seq decent predict but letter by letter instead of words 🤗Transformers	2	469	August 9, 2022
How to train transformer (seq-to-seq) for very large seq? 🤗Transformers	0	251	October 4, 2021
In transformer, if the text exceeds max_seq_length, how to deal with it 🤗Transformers	0	382	January 19, 2024