Cuda out of memory on Google Colab when running Blip2

sophchoe September 21, 2023, 2:40pm 1

When using Google Colab for
model = Blip2ForConditionalGeneration.from_pretrained(
“Salesforce/blip2-flan-t5-xl”…

giving cuda out of memory error. How do I resolve this?

Topic		Replies	Views
Running out of System RAM while loading BLIP2 on Colab? 🤗Transformers	0	385	November 15, 2023
Runtime error: CUDA out of memory, not sure if accelerate offloading is working Beginners	0	878	October 2, 2023
CUDA is out of memory Beginners	3	3286	October 9, 2023
Always getting RuntimeError: CUDA out of memory with Trainer 🤗Transformers	10	6784	April 4, 2024
TPU Out of memory in Pix2Struct ForConditionalGeneration model Intermediate	0	244	August 13, 2023