I am going to load my saved BERT tokenizer with about 38,000 tokens, but each time it is going to be loaded, it takes about 5 minutes to load; however the original BERT one, can be loaded in second.
How can I know the reason of that?
I am going to load my saved BERT tokenizer with about 38,000 tokens, but each time it is going to be loaded, it takes about 5 minutes to load; however the original BERT one, can be loaded in second.
How can I know the reason of that?