Which loss function in bertforsequenceclassification regression

BramVanroy · October 9, 2020, 9:12am

You can select the lines that you are interested in on a Github code page, then click on the three dots and select copy permalink:

github.com

huggingface/transformers/blob/9aeacb58bab321bc21c24bbdf7a24efdccb1d426/src/transformers/modeling_bert.py#L1353-L1360


if labels is not None:
    if self.num_labels == 1:
        #  We are doing regression
        loss_fct = MSELoss()
        loss = loss_fct(logits.view(-1), labels.view(-1))
    else:
        loss_fct = CrossEntropyLoss()
        loss = loss_fct(logits.view(-1, self.num_labels), labels.view(-1))

Topic		Replies	Views
Class weights for bertForSequenceClassification Beginners	10	12758	May 29, 2022
Fine-tune BERT and Camembert for regression problem Beginners	17	11235	December 4, 2021
How to fine-tune Bert on STS-B task? Beginners	2	1440	August 4, 2021
How do I do multi Class (multi head) classification? 🤗Transformers	6	4482	October 18, 2022
How to convert single-class BertForSequenceClassification prediction into probability? Models	0	425	August 4, 2022

Which loss function in bertforsequenceclassification regression

Related topics