Downloaded bert transformer model locally, and missing keys exception is seen prior to any training
Torch 1.8.0 , Cuda 10.1 transformers 4.6.1
bert model was locally saved using git command
git clone https://huggingface.co/bert-base-uncased
in the code below i am loading the model and state_dict from the same exact folder where i have downloaded the model fresh from the huggingface repo.
from transformers import AutoModel import torch state_dict = torch.load(".../bert-base-uncased/pytorch_model.bin") model = AutoModel.from_pretrained("..../bert-base-uncased/") model.load_state_dict(state_dict, strict=False)
IncompatibleKeys(missing_keys=['embeddings.position_ids', 'embeddings.word_embeddings.weight' …
Any help is appreciated.