Hello, How pre-trained are obtained? In the library there is always some pre-trained model downloaded from the server, but how is it originally trained? Is it also trained using transformers library?

How pretrained models are trained?

al31415 October 2, 2020, 8:14am 3

Thanks for reply.
How can I train my own model from scratch using transformers?

Topic		Replies	Views
Train a transformer from scratch 🤗Transformers	0	442	August 9, 2021
Original transformers model implementation Beginners	2	997	June 1, 2022
Further pre-train language model in transformers like BERT Models	3	1117	March 27, 2022
Way to train a basic Transformer Beginners	6	646	November 21, 2020
How were the GPT2 pretrained tensorflow models created? 🤗Transformers	1	381	July 20, 2020