Fine tune large model on a single gpu

Models
1

Hi, I want to fine tune large model like gpt-j, mgpt, gpt-neo in colab using single GPU.

Can some one provide me, an example how I can load large model on single gpu to fine tune further for downstream task.