Use BertLMHeadModel to finetunning a language model

[davidhu]

Is it possible to use BertLMHeadModel to finetune a language model if i set the is_decoder=True ?