Hi,
I am trying to train a T5-base on Colab with the TPU. I am using the official code to perform a fine-tuning on the T5-base (with my dataset), but the training with TPU is extremely slow! I’m using the offical code.
I am attaching the colab code with the various libraries I have installed: notebook.
Also, if I try to increase the batch size as >= 64, I get a memory error, as there seems to be only about 8 Gb available.
Can someone help me? Thank you!