Hi I am trying to test the trainer API of huggingface through this small code snippet on a toy small data. Unfortunately I am getting cuda memory error although I have 32gb cuda memory which seems sufficient for this small data. Any help will be greatly appreciated from datasets import load_datase…

Cuda out of memory while using Trainer API

Emanuel October 20, 2021, 1:29pm 2

Could this be related to this issue?

Topic		Replies	Views
Always getting RuntimeError: CUDA out of memory with Trainer 🤗Transformers	10	6959	April 4, 2024
Cuda memory error even when passing the no_cuda argument 🤗Transformers	0	612	November 23, 2022
How to get the Trainer API to use GPU? Beginners	0	1565	May 21, 2021
How to prevent Huggingface Trainer from reaching out of memory? Beginners	0	384	February 8, 2022
Training out of memory 🤗Transformers	0	231	July 18, 2024