Hi All, I implemented my custom Bert Binary Classification Model class, by adding a classifier layer on top of Bert Model (attached below). However, the accuracy/metrics are significantly different when I train with the official BertForSequenceClassification model, which makes me wonder if I am mis…

Metrics mismatch between BertForSequenceClassification Class and my custom Bert Classification

adrshkm December 10, 2020, 11:35pm 3

This makes sense. In that case why is my custom BERT Classification Model’s accuracy lower than the official BertForSequnceClassification?

Topic		Replies	Views
Weights not downloading Beginners	3	1846	May 24, 2021
Trying to understand XForSequenceClassification heads Intermediate	8	1323	September 24, 2020
How do i take only "BERT" weights from BertForSequenceClassification model? 🤗Transformers	0	1445	February 16, 2022
Further Pretrain Basic BERT for sequence classification 🤗Transformers	4	1812	October 9, 2020
Fine-Tune BERT with two Classification Heads "next to each other"? Beginners	3	2696	September 17, 2021