So for the method load_tf_weights_in_bert
,the ckpt
is still read using pytorch.
Does it mean I can’t load ckpt
file in a enviement that just have tensorflow?
That’s really complex.
The framework like keras-bert
、keras4bert
both can load ckpt
. Can transformers
add this method in a new version?
Because for those of us who are not native English speakers,we need use some like bert-chinese-tiny
, CHINESE ALBERT
(pretrain by Chinese team) and even the models from google-search’s github. They can download from Internet easily.
But it same like load them into model is a really difficult thing when use the transformers