Hi everyone, I am new to this huggingface. I have a new architecture that modifies the internal layers of the BERT Encoder and Decoder blocks. Though, I can create the whole new model from scratch but I want to use the already well written BERT architecture by HF. How can I modify the layers in BE…

How to modify the internal layers of BERT

calusbr June 3, 2021, 11:01am 10

I’m having the same problem and would like to know if you have code that managed to change layers? It would help me a lot in my studies.

1 Like

Topic		Replies	Views
Modify bert embeddings 🤗Transformers	0	387	January 18, 2022
New layer in bert embeddings 🤗Transformers	1	707	April 1, 2022
Modify BERT encoder layers? 🤗Transformers	0	1034	June 18, 2021
New Layer in BERT 🤗Transformers	0	210	September 25, 2022
How to add a new input layer to BERT / RoBERTa? Beginners	0	921	April 26, 2022