I looking for an easy-to-follow tutorial for using Huggingface Transformer models (e.g. BERT) in PyTorch on Google Colab with TPUs. I found guides about XLA, but they are largely centered around TensorFlow. Any help would be appreciated.

Tutorials for using Colab TPUs with Huggingface Transformers?

facehugger2020 December 7, 2020, 11:15pm 8

I filed a Github issue with the XLA team.

2 Likes