Hi, first of all, thanks for creating such a cool library :blush: I have already successfully fine-tuned a GPT2 model and I currently want to fine-tune a GPT2-Large model from the same 1.4 GB training dataset, but I seem to be running out of memory. When I run the run_clm.py script, I usually get…

Running out of Memory with run_clm.py

lewtun April 13, 2021, 7:23pm 2

Hey @MarkStrong do you still get memory issues if you reduce the batch size?

Topic		Replies	Views
How to deal with tokenizer out of memory in run_clm.py Beginners	0	302	March 22, 2023
Repeated training runs out of GPU memory 🤗Transformers	3	272	December 16, 2024
Run_clm.py: why does the tokenizer phase use so much memory? 288GB for <2GB input data Beginners	1	329	February 4, 2024
Do the data-load pipeline have the memory limit? I have not test it, Thank you! Beginners	0	278	May 24, 2023
Missmatch between memory-estimate and Trainer-API Beginners	0	183	January 23, 2024