Hugging Face Forums
Use BertLMHeadModel to finetunning a language model
🤗Transformers
davidhu
March 30, 2021, 7:38am
1
Is it possible to use BertLMHeadModel to finetune a language model if i set the is_decoder=True ?
Related topics
Topic
Replies
Views
Activity
Questions on the `BertModelLMHeadModel`
🤗Transformers
7
6296
October 5, 2020
Fine-tuning lm with nsp
🤗Transformers
0
1168
January 19, 2021
BERT2BERT Notebook for Models without GenerationMixin
🤗Transformers
0
289
November 12, 2020
BERT2RND EncoderDecoderModel predicts random words for Translation tasks
🤗Transformers
0
384
May 30, 2022
Smart Batching - speech up Bert finetune
Intermediate
0
683
March 15, 2021