Hello, I want to use HateBERT from the paper’s repository , which is a BERT model that its pre-training was extended in abusive language. In order to do that, I created a BERT model (bert-base-uncased in PyTorch) and tried to load HateBERT’s weights with load_state_dict() (after having made minor c…

Clarify BERT model learnable parameters

hfnlpmb November 4, 2021, 2:29pm 5

1 Like

Topic		Replies	Views
Loading model from pytorch_pretrained_bert into transformers library 🤗Transformers	2	8112	January 5, 2022
Missing keys "model.embeddings.position_ids" when loading model using state_dict Beginners	4	11179	August 21, 2020
Weights in BERT model 🤗Transformers	1	1763	April 12, 2023
Loading pytorch_pretrained_bert models with transformers Beginners	2	1924	April 29, 2021
Missing keys when loading a model checkpoint (transformer) Models	0	1570	November 10, 2021