Huggingface/transformers is such a convenient library to use when it comes to all sorts of pertained model. But I am wondering is there a convenient way to train a model from scratch ?
If I want to rebuild the model in
Attention is all you need , the first thought came into my mind is change
modeling_bart.py to adapt to
Attention is all you need setting and do not
from_pretrained, Is there any better way to do it ?
I am looking forward to your reply