Fine tune mt5 model on single gpu?

3aliahamwi September 24, 2021, 3:55pm 1

Hello

Can I fine-tune the mt5-small model on a single GPU in free Colab or gtx1650 ?

Topic		Replies	Views
Fine tune large model on a single gpu Models	0	272	November 30, 2022
Mt5 fine-tuning using fp16 yields zero loss 🤗Transformers	1	545	April 23, 2023
Running mT5 on multiple GPUs Models	0	444	July 26, 2022
What GPU should I use to fine tune LongT5? Beginners	0	245	January 27, 2023
Why does all my gpu memory get used with a small model? Beginners	5	1656	March 13, 2022