GPT2DoubleHeadsModel

I have a question concerning training GPT2DoubleHeadsModel, in my setting only mc_labels is provided, and I want to train it with multiple choice loss, but I get : The model did not return a loss from the inputs, only the following keys: mc_loss,logits,mc_logits,past_key_values. For reference, the inputs it received are input_ids,attention_mask,mc_labels,mc_token_ids. Is there a way to train the model with trainer API under this circumstance?