Hi, I have some embeddings that I would like to finetune using BERT mlm script. Its an embedding.pt file. While passing this embedding with --model_name_or_path to run_mlm.py, it throws an error saying pytorch_model.bin not found in the folder. Is this only about converting .pt to .bin file or is there some other way? I also tried setting from_pt=True in the script while loading the model using AutoModelforMaskedLM. Any suggestions?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Loading pre-trained BERT model error - Error no file named ['pytorch_model.bin', 'tf_model.h5'] found | 0 | 3572 | December 1, 2020 | |
| Very poor model performance post-training | 0 | 384 | November 1, 2021 | |
| How to load a torch model with transformers? | 5 | 16179 | June 22, 2023 | |
| How to train from scratch with run_mlm.py, .txt file? | 20 | 6585 | September 22, 2024 | |
| How to load model with .pth and avoid ponderous pytorch_model.bin | 0 | 1677 | September 8, 2023 |