I have this trainer code on a sample of only 10,000 records, still the GPU runs out, I am using Google Colab pro, before that it didnt happen with me, something wrong in my code, please see from transformers import DistilBertForSequenceClassification, Trainer, TrainingArguments training_args = Tra…

Colab error (memory crashes)

rgwatwormhill October 8, 2020, 8:28pm 2

How big is each record? How big is it after tokenization?
Are you using a data-loader? What batchsize is it using?

What happens if you you try to train using only 10 records?

Topic		Replies	Views
Always getting RuntimeError: CUDA out of memory with Trainer 🤗Transformers	10	6959	April 4, 2024
Colab session crashing after using all available RAM Beginners	0	2424	January 16, 2021
Colab RAM crash error - Fine-tuning RoBERTa in Colab Beginners	3	6522	December 15, 2020
How to train a gpt2 with colab pro Models	16	3752	February 29, 2024
Google/gemma-2-2b-it Crashes in Google colab Models	0	55	September 5, 2024