BertForSequenceClassification: Can I get the last hidden state?

petasis · January 9, 2023, 10:35pm

Hi all,

Is there a way to get the last hidden state (only) from a BertForSequenceClassification instance?

If I enable the output_hidden_states=True config option, I get an out of memory error during evaluation.

Regards,

George

Topic		Replies	Views
Question about last_hidden_state of the bert model Beginners	0	296	December 7, 2023
Is last_hidden_state the output of Encoder block? Beginners	1	432	December 23, 2021
For tuning a classifier head on a pretrained BERT should I use `last_hidden_state` or `outputs[0][:, 0, :]` from the BERT? Beginners	0	159	February 15, 2024
MaskedLMOutput does not have last_hidden_state 🤗Transformers	0	1393	May 27, 2021
T5forConditionalGeneration + classification Models	3	1246	December 13, 2020