I want to fine-tune a bert model in Tensorflow (keras) and then visualise its attention weights in PyTorch (bertviz).
This documentation page https://huggingface.co/transformers/converting_tensorflow_models.html suggests that it might be possible to convert a tensorflow model to a pytorch model, but I don’t understand how to do it.
Firstly, what is transformers-cli? Is it a module? Do I need to import it? Where can I find out more about it? I’m using colab, so that includes transformers v 3.0.2 by default.
Secondly, when I click on the Examples links run_bert_extract_features.py, run_bert_classifier.py and run_bert_squad.py) I get a Github 404 page not found. Should they be there? Do I need to search within Github specificallly?
Thirdly, can the process be done within a colab jupyter notebook, or would I have to get a colab command line somehow? (Any hints on how would be appreciated!)