Are the weights of the maskedLM head of the `BertForMaskedLM` model pre-trained?

🤗Transformers
1

Hello,
Are the weights of the maskedLM output head of the BertForMaskedLM model pre-trained?
Or are the weights of the maskedLM output head randomly initialized each time the model is called?

Thank you,