I am fine-tuning several binary classification BERT models, all using bert-base-uncased. I understand that I can save my trained model and reload it later. I noticed that in the stored folder, the largest file is pytorch_model.bin (478MB), which appeared in every model I saved. If this is the pre-trained model (before finetuning), can I save it only once and later using it when loading different models?
Related Topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Saving standard BertModel english and BertModel multilingual have drastically different sizes? | 2 | 251 | August 28, 2020 | |
Predicting with model and trying to save at the same time gives different prediction results and doesnt save | 0 | 310 | April 8, 2023 | |
BERT model is slow in Pytorch | 5 | 517 | November 30, 2023 | |
Loading pytorch_pretrained_bert models with transformers | 2 | 1753 | April 29, 2021 | |
Empty BERT Model, any help? | 2 | 366 | January 5, 2024 |