Hi I have sentences with additional features for each (a 5 dims vector of floats) and a label for each (True or False). So an example of sample: “hello have a nice day”, [0.2, 0.1, 0.6, 0.7, 0.2], True I have a classification task on my data. I want to finetune Bert to take input_sentence, con…

How to concatenate additional features to the last layer of Bert

nielsr January 13, 2024, 2:42pm 4

Hi,

Topic		Replies	Views
Combine BertForSequenceClassificaion with Additional Features 🤗Transformers	3	8600	March 23, 2022
Understanding how to implement custom BERT model Beginners	0	476	November 22, 2021
Concatenate non string features to a BERT transformers model Beginners	5	2442	March 27, 2022
How to concatenate the word embedding for special tokens and words Intermediate	1	2404	June 13, 2021
Add per-word embedding from outer source to Bert embedding layer Beginners	0	259	January 14, 2024