Hi everyone, Is it possible to bypass the tokenizer and directly provide the input embeddings to train the BERT model? Thanks!

Bypassing tokenizers

sgugger November 23, 2020, 1:49pm 3

You can also feed input_embeds instead of input_ids to your mdel.

1 Like

Topic		Replies	Views
Modify bert embeddings 🤗Transformers	0	381	January 18, 2022
Bert embeddings Beginners	0	358	January 6, 2022
Customize tokenizer in model card's widget Beginners	1	354	November 3, 2020
BERT modified embeddings 🤗Transformers	0	397	January 8, 2022
How to modify the internal layers of BERT 🤗Transformers	12	16536	July 19, 2023