Hi I am trying to test the trainer API of huggingface through this small code snippet on a toy small data. Unfortunately I am getting cuda memory error although I have 32gb cuda memory which seems sufficient for this small data. Any help will be greatly appreciated from datasets import load_datase…

Cuda out of memory while using Trainer API

Emanuel October 20, 2021, 1:29pm 2

Could this be related to this issue?

Topic		Replies	Views
Always getting RuntimeError: CUDA out of memory with Trainer 🤗Transformers	10	6785	April 4, 2024
How to get the Trainer API to use GPU? Beginners	0	1540	May 21, 2021
OutOfMemoryError: CUDA out of memory Beginners	0	906	June 30, 2023
Out of memory error when using trainer & output_hidden_states 🤗Transformers	0	692	January 10, 2023
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 256.00 MiB (GPU 0; 39.56 GiB total capacity; 37.84 GiB already allocated; 242.56 MiB free; 37.96 GiB reserved in total by PyTorch) 🤗Transformers	2	5160	June 7, 2023