Hugging Face Forums
Use BertLMHeadModel to finetunning a language model
🤗Transformers
davidhu
March 30, 2021, 7:38am
1
Is it possible to use BertLMHeadModel to finetune a language model if i set the is_decoder=True ?
Related topics
Topic
Replies
Views
Activity
Bert2bert translator?
🤗Transformers
6
44
August 28, 2025
Questions on the `BertModelLMHeadModel`
🤗Transformers
7
6286
October 5, 2020
BERT2RND EncoderDecoderModel predicts random words for Translation tasks
🤗Transformers
0
384
May 30, 2022
Fine-tuning lm with nsp
🤗Transformers
0
1167
January 19, 2021
BERT2BERT Notebook for Models without GenerationMixin
🤗Transformers
0
289
November 12, 2020