I have a question concerning training GPT2DoubleHeadsModel, in my setting only mc_labels is provided, and I want to train it with multiple choice loss, but I get : The model did not return a loss from the inputs, only the following keys: mc_loss,logits,mc_logits,past_key_values. For reference, the inputs it received are input_ids,attention_mask,mc_labels,mc_token_ids. Is there a way to train the model with trainer API under this circumstance?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Api and parameters change from transofrmers 2.5.1 to 3.5.1 for GPT2 | 0 | 241 | January 4, 2021 | |
| Key Error 'loss' while fine tuning GPT-2 with the Trainer utility | 9 | 7474 | May 10, 2022 | |
| Labels in language modeling: which tokens to set to -100? | 1 | 3488 | November 30, 2020 | |
| Is the multiple-choice head for the pre-trained `LongformerForMultipleChoice` model pre-trained as well? | 1 | 349 | October 2, 2020 | |
| TFOpenAIGPTDoubleHeadsModel Loss Function | 0 | 241 | August 6, 2020 |