Replace roberta embedding with bge_base embedding in layoutlmv3

shm141 · August 29, 2023, 3:25pm

I’m experimenting Funsd like dataset for token classification using layoutLmv3, I’m trying to replace roberta embedding with bge_base, Is it possible to replace the embedding? will it improve the accuracy?

Topic		Replies	Views
Different size of Roberta-base tokenizer and model embedding Beginners	1	1103	March 1, 2022
LayoutLMV3 embeddings Beginners	4	1102	August 3, 2022
Layoutlmv3 sequence_length vs token_sequnce_length size mismatch Models	2	697	November 19, 2022
No option for embedding size in transformers.RobertaConfig Beginners	1	197	January 23, 2023
Getting different sentence embeddings when using model on CPU and GPU Beginners	0	2299	August 26, 2022

Replace roberta embedding with bge_base embedding in layoutlmv3

Related topics