Fine-tune OPT 13B: CUDA out of memory error (720gb vram, batch size 1, fp16)!

Worked like a charm! Thank you @sgugger you rock!!!

1 Like