Hi I am trying to test the trainer API of huggingface through this small code snippet on a toy small data. Unfortunately I am getting cuda memory error although I have 32gb cuda memory which seems sufficient for this small data. Any help will be greatly appreciated from datasets import load_datase…

Cuda out of memory while using Trainer API

Emanuel October 20, 2021, 1:29pm 2

Could this be related to this issue?

Topic		Replies	Views
How to get the Trainer API to use GPU? Beginners	0	1571	May 21, 2021
Always getting RuntimeError: CUDA out of memory with Trainer 🤗Transformers	10	6974	April 4, 2024
How to prevent Huggingface Trainer from reaching out of memory? Beginners	0	385	February 8, 2022
Cuda memory error even when passing the no_cuda argument 🤗Transformers	0	616	November 23, 2022
Out of memory error when using trainer & output_hidden_states 🤗Transformers	0	713	January 10, 2023