Fine tune mt5 model on single gpu?

3aliahamwi September 24, 2021, 3:55pm 1

Hello

Can I fine-tune the mt5-small model on a single GPU in free Colab or gtx1650 ?

Topic		Replies	Views
Fine tune large model on a single gpu Models	0	320	November 30, 2022
Mt5 fine-tuning using fp16 yields zero loss 🤗Transformers	1	631	April 23, 2023
Running mT5 on multiple GPUs Models	0	516	July 26, 2022
What GPU should I use to fine tune LongT5? Beginners	0	303	January 27, 2023
mT5/T5v1.1 Fine-Tuning Results Models	16	7430	March 8, 2022