Use BertLMHeadModel to finetunning a language model

davidhu March 30, 2021, 7:38am 1

Is it possible to use BertLMHeadModel to finetune a language model if i set the is_decoder=True ?

Topic		Replies	Views
Questions on the `BertModelLMHeadModel` 🤗Transformers	7	4876	October 5, 2020
Usind a fine-tuned sentence completion model in a Masked LM task 🤗Transformers	2	267	September 23, 2021
Using BERT and RoBERTa for (causal?) language modeling 🤗Transformers	6	4017	October 2, 2021
BertForMaskedLM model require fine-tuning? Beginners	0	547	August 7, 2022
Load fine tuned model from local Beginners	4	9348	October 20, 2020