GPT2 with TensorFlow?

[Jung]

I am not aware of public notebooks regarding training Huggingface’s TFGPT2, but we have public notebooks of training TFT5 and TFXLM-R , which should give you some ideas

TF-T5

Google Colaboratory

TF-XLM-R

Finetune XLM-Roberta on Jigsaw test data with MLM